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PREFACE 


This  Note  presents  an  analysis  of  the  historical  accuracy  with 
which  enlisted  force  manpower  strengths  can  be  forecast  using  simple-- 
and  widely  used--modeling  assumptions.  The  accuracy  of  one-,  three-, 
and  five-year  forecasts  is  presented  for  enlisted  personnel  groups 
from  all  four  military  services  for  fiscal  years  1971  through  1980. 

This  work  is  a  first  step  in  designing  and  implementing  an  enlisted 
forecasting  system  for  the  Office  of  Enlisted  Personnel  Management.  The 
study  was  conducted  for  that  office  under  Task  Order  82-1 1-2  and  83-1 1 -2 
in  Contract  MDA903-80-C-0652 .  It  was  sponsored  by  the  Office  of  the 
Assistant  Secretary  of  Defense  (Manpower,  Installations  and  Logistics) 
and  performed  at  Rand's  Defense  Manpower  Research  Center. 

Each  year,  military  pay  increases  and  bonus  payments  budgets  are 
determined  partly  on  the  basis  of  forecasts  of  the  number  of  enlisted 
personnel  who  will  continue  serving.  Forecasts  showing  persistent 
shortfalls  from  requirements  usually  result  in  additional  pay--in  the 
form  of  either  bonus  payments  or  pay  raises.  The  accuracy  of  these 
forecasts,  so  critical  to  sizing  large  bonus  and  pay  budgets,  has  not 
systematically  been  tracked. 

Forecasts,  of  course,  can  be  made  with  a  variety  of  models  using 
different  assumptions.  This  Note  focuses  on  the  accuracy  of  a  simple, 
widely  used  technique  to  forecast  enlisted  strengths.  Estimating  the 
accuracy  of  forecasts  and  analyzing  the  pattern  of  errors  allow  an 
assessment  of  the  need  for  more  sophisticated  techniques,  help  in 
developing  a  strategy  for  disaggregating  enlisted  groups  when 
forecasting,  and  form  a  basis  for  the  design  of  an  improved  enlisted 
forecasting  system. 
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SUMMARY 


Each  of  the  four  military  services  has  an  interconnected  set  of 
enlisted  force  planning  models  which  are  used  to  estimate  critical 
aggregate  manpower  parameters  such  as  end  strength,  accession 
requirements,  first  term/career  mix,  and  budget  levels  for  enlisted  pay 
and  bonuses.  A  critical  component  of  each  of  these  models  is  a  forecast 
of  the  number  and  type  of  enlisted  personnel  leaving  the  service.  Poor 
estimates  of  enlisted  force  losses  can  result  in  higher  than  necessary 
enlisted  pay  and  bonus  levels  or  manpower  shortages.  it  can  result  in 
policymaking  characterized  by  reaction  rather  than  anticipation,  and  can 
have  severe  long-term  opportunity  costs  in  terms  of  enlisted  force 
structures  which  deviate  substantially  from  the  required  structure. 

This  study  documents  the  historical  accuracy  of  cne-,  three-,  and 
five-year  forecasts  for  enlisted  manpower  cohorts  for  fiscal  years  1971 
through  1980  for  a  simple--and  widely  used--enlisted  force  forecasting 
technique.  It  documents  this  accuracy  for  each  of  the  four  services  for 
various  disaggregated  enlisted  force  groups.  As  such,  it  provides 
managers  with  realistic  estimates  of  errors  for  this  technique  and  an 
improved  ability  to  hedge  policies  so  that  enlisted  force  objectives  can 
be  met  with  a  higher  degree  of  confidence.  This  study  also  interprets 
the  pattern  of  errors  in  forecasting  and  compares  the  errors  with  those 
of  a  standard  statistical  distribution  which  suggests  directions  for 
improving  these  forecasts.  Finally,  it  describes  possible  barriers  to 
implementing  improved  forecasting  techniques.  This  work  was  undertaken 
as  a  first  step  in  the  design  and  implementation  of  an  enlisted 
forecasting  system  for  the  Office  of  Enlisted  Personnel  Management. 

The  simple  continuation  rate  models  tested  here  provide  reasonably 
accurate  short-term  forecasts  of  the  level  and  structure  of  enlisted 
personnel  strength.  However,  long-term  forecasts  show  very  large  errors 
for  certain  enlisted  groups.  The  error  pattern--which  is  stable  across 
the  services--shows  a  distinct  structure  when  estimated  by  year  of 
service.  For  enlisted  personnel  in  the  first  two  years  of  service, 
there  is  a  surprisingly  small  one-year  forecast  error.  For  the  years 
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1976-80,  the  mean  absolute  percentage  error  for  one-year  forecasts  has 
been  less  than  4  percent  for  each  service.  These  errors  increase  to 
15-30  percent  for  three-  and  five-year  forecasts.  The  largest  error 
rates  are  for  enlisted  groups  with  between  three  and  six  years  of 
service  and  for  groups  with  greater  than  20  years  of  service.  For  the 
former  group,  mean  absolute  percentage  errors  for  one-year  forecasts  are 
less  than  10  percent,  and  increase  to  the  10-20  percent  range  for  th^ee- 
and  five-year  forecasts.  For  the  latter  group,  one-year  forecast  errors 
are  less  than  10  percent,  but  can  rise  to  40  percent  for  five-year 
forecasts.  Error  rates  for  year  of  service  groups  between  7  and  19  are 
less  than  3  percent  for  one-year  forecasts  and  9  percent  for  three- 
and  five-year  forecasts.  For  year  of  service  groups  between  12  and  19, 
the  errors  are  close  to  random. 

One  method  used  to  improve  simple  forecasts  is  to  disaggregate  the 
enlisted  force  into  finely  grained  groups  prior  to  forecasting.  We  have 
found  that  disaggregation  improves  forecasting  only  slightly,  and 
probably  most  models  could  be  simplified  by  less  d isaggregat .on .  We 
have  also  found  that  simple  models  do  extremely  well  for  many  groups, 
and  more  sophisticated  techniques  are  warranted  only  for  certain  gmups 
witv  high  nonrandom  error  rates. 

The  pattern  of  forecast  errors  is  consistent  with  the  hypothesis 
that  nonrandom  factors  present  during  years  of  service  3  through  10  and 
20  through  30  are  the  primary  cause  of  forecast  errors.  This  pattern 
seems  to  support  the-  results  of  econometric  models  which  have  shown  tie- 
importance  of  factors  connected  with  the  economic  cycle  in  retention 
decisionmaking.  Incorporation  of  these  behavioral  models  into  enlisted 
force  planning  models  may  improve  forecasting  accuracy  markedly.  This 
mcorporat  ion  will  allow  the.  services  to  address  an  important  continuing 
problem  in  enlisted  personnel  management- -dove  lop ing  a  set  of 
countercyclical  policies  to  mitigate  the  effects  of  economic  cycles  on 
c-niisted  force  trends.  However,  this  incorporation  must  take  account  cf 
barriers  which  have  prevented  this  incorporation  to  date,  must  recogn  i 
that  ad  hoc  methods  of  incorporation  might  not  improve  accuracy,  and 
recognize  an  associated  need  to  develop  a  process  that  both  develops 
common  economic  assumptions  across  services  and  tracks  the  accuracy  of 
service  forecasts. 
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Table  2.3  displays  the  active  enlisted  force  population  by  years  of 
service  (YOS)  as  of  the  end  of  each  fiscal  year.2  Tables  2.4  through 
2.7  provide  a  similar  display  for  each  service.  This  period  was 
characterized  by  a  declining  force  size  in  the  aftermath  of  Vietnam  and 
the  transition  to  an  all-volunteer  force.  The  Army  experienced  the 
largest  drop  in  enlisted  strength  during  the  period--a  decline  of  31 
percent  from  972,000  to  674,000.  The  other  services  experienced  smaller 
declines . 

Tables  2.8  through  2.12  summarize  the  continuation  rates  for 
individuals  enlisted  at  the  beginning  of  each  fiscal  year.  These  data 
provide  the  percentage  of  individuals  ennumerated  in  Tables  2.3  through 
2.7  who  are  still  present  one  year  later.  These  annual  retention  rates’ 
are  one  measure  of  force  stability  and  are  key  parameters  in  manpower 
planning. 

Annual  continuation  rates  differ  by  years  of  service  and  over  time 
in  easily  explainable  ways.  Overall  continuation  rates  for  DoD  enlisted 
personnel  (see  Table  2.13)  rose  from  66.1  to  82.3  percent  between  FY71 
and  FY80.  This  dramatic  rise  in  force-wide  retention  rates  is  primarily 
attributable  to  changes  in  manpower  policy  and  personnel  characteristics 
triggered  by  the  end  of  the  Vietnam  war  and  the  transition  to  an  all¬ 
volunteer  force.  During  the  Vietnam  war,  most  of  the  expansion  in  force 
size  was  from  draftees  who  were  cycled  through  the  force  for  short  two- 
year  terms,  causing  low  overall  retention  rates.  The  post-Vietnam 
reduction  in  force  size  in  FY71  and  FY72  reduced  the  number  of  draftees 

JFrom  FY71-FY76  the  end  of  the  fiscal  year  was  June  3D.  For 
FY77-FY80  the  e.nd  of  the  fiscal  year  was  September  30. 

’in  this  Note,  we  will  use  retention  or  continuation  rate  to 
indicate  a  ratio,  where  the  denominator  is  given  by  the.  number  of 
individuals  present  at  the  beginning  of  a  fiscal  year  and  the  numerator 
as  the  number  of  those  individuals  still  present  as  evidenced  by  social 
security  matches  one  year  later.  Reenlistment  rate,  is  the  ra. io  of 
those,  accepting  a  new  term  commitment  to  those  having  an  ETS  decision 
during  a  year.  Extension  rate  is  the  ratio  of  those  staying  but  not 
accepting  a  term  commitment  to  those  having  an  ETS  decision.  In 
modeling  and  characterizing  entire  manpower  systems,  retention  rates 
have  the  advantage  that  it  is  unnecessary  to  distinguish  between 
reenlistment  and  extension.  While  most  econometric  work  has  focused  on 
a  particular  reenlistment  decision,  more  recent  work  has  shown  that 
extension  behavior  is  also  an  important  component  of  retention. 
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attention  because  larger  deviation  from  requirements  will  occur  more 
frequently. 

The  expected  accuracy  of  prediction  also  varies  with  the  retention 
probability.  Other  things  equal,  percentage  deviation  from  requirements 
will  be  less  frequent  with  retention  groups  having  higher  retention 
probabilities.  For  instance,  at  the  95  percent  confidence  level  and 
n  =  1000,  the  accuracy  falls  from  12.3  percent  at  p  =  .2  to  3.1  percent 
at  p  =  .8. 

Actual  retention  behavior  may  not  follow  the  binomial  distribution 
because  the  decisions  are  influenced  by  nonrandom  factors  such  as 
civilian  wage  and  unemployment,  and  policy  factors  such  as  military  pay 
and  reenlistment  eligibility  criteria.  However,  the  extent  to  which 
these  nonrandom  factors  affect  retention  can  be  measured  by  how  far  the 
results  of  year  to  year  variation  differ  from  the  binomial  distribution. 
In  our  simple  model,  the  binomial  distribution  gives  a  minimum  possible 
uncertainty1  in  accuracy  of  repeated  trials.  Other  nonpolicy  influences 
will  always  act  to  increase  this  deviation  over  the  long  run. 

THE  DATA 

At  Rand's  request,  the  Defense  Manpower  Data  Center  has  constructed 
a  file  which  determines  the  end  of  the  fiscal  year  continuation  status 
for  each  individual  in  the  active  force  at  the  beginning  of  the  fiscal 
year.  Starting  with  the  FY71  active  force  personnel  file,  a  flag  has 
been  attached  to  each  individual  record  indicating  whether  the 
individual  was  present  at  the  end  of  the  fiscal  year  (June  30,  1972). 
This  file  contains  records  for  FY71  through  FY80--a  total  of  over  25 
million  records.  (See  Appendix  A  for  the  data  elements  on  the  file.) 

This  micro-data  file  basically  summarizes  the  annual  retention 
behavior  of  each  person  in  the  active  force  over  the  period  FY71-FY80. 

As  such,  it  can  serve  as  the  basis  for  tracking  the  accuracy  of  various 
methods  for  forecasting  retention. 


lThis  assumes  that  the  correlation  between  events  is  zero.  Certain 
manpower  policies  directed  toward  correlating  retention  decisions  can 
reduce  this  uncertainty  below  binomial.  An  example  would  be  initiating 
a  bonus  policy  late  in  a  time  period  in  response  to  low  retention  rate, 
early  in  a  time  period. 
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Table  2.2 

EXPECTED  YEAR  TO  YEAR  PERCENTAGE  ACCURACY  IN  REENLISTMENT 
PROBABILITY  ASSUMING  BINOMIAL  DISTRIBUTION 


Confidence  Level 


50% 

75% 

90% 

95% 

99% 

N  =  100 

13.5 

23.0 

32.9 

39.2 

51.5 

p  =  .20  N  =  1000 

4.3 

7.3 

10.4 

12.3 

16.2 

N  =  10,000 

1.4 

2.3 

3.3 

3.9 

5.2 

N  =  100,000 

.4 

.7 

1.0 

1.2 

1.6 

N  =  100 

8.3 

14.1 

20.2 

24.0 

31.5 

p  =  .  40 

N  =  1000 

4.1 

7.0 

10.1 

12.0 

> — * 
Ui 

OO 

N  =  10,000 

.8 

1.4 

2.0 

2.0 

3.2 

N  =  100,000 

.4 

.7 

1.0 

1.2 

1.6 

N  =  100 

6.8 

11.5 

16.5 

19.6 

2.58 

p  =  .50 

N  =  1000 

2.1 

3.6 

5.2 

6.2 

8.1 

N  =  10,000 

.7 

1.2 

1.7 

2.0 

2.6 

N  =  100,000 

.2 

.4 

.5 

.6 

.8 

N  =  100 

5.5 

9.4 

13.4 

16.0 

21.0 

p  =  .  60 

N  =  1000 

1.7 

3.0 

4.3 

5.1 

6.7 

N  =  10,000 

.6 

.9 

1.3 

1.6 

2.1 

N  =  100,000 

.2 

.3 

.4 

.5 

.  7 

N  =  100 

3.4 

5.8 

8.2 

9.8 

12.9 

p  =  .8  N  =  1000 

1.1 

1.8 

2.6 

3.1 

4.1 

N  =  10,000 

.3 

.6 

.8 

1.0 

1.3 

N  =  100,000 

.  1 

.2 

.3 

.3 

.4 

management  techniques  for  Military  Occupational  Specialty  (MOS)  groups 
of  different  size.  Other  things  equal,  MOS  with  a  small  number  of 
people  will  likely  have  a  larger  percentage  deviation  from  requirement 
than  those  having  more  people.  In  a  sense,  large  MOS  groups  tend  to 
manage  themselves,  whereas  smaller  MOS  groups  require  more  management 
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Table  2.1 

MEAN  AND  STANDARD  DEVIATION  OF  BINOMIAL  DISTRIBUTION 


Number 

Reenlisting 

.2 

.4 

Reenlistment 

.5 

Rate 

6 

.8 

10 

2 

(1.3) 

4 

(1.5) 

5 

(1.6) 

6 

(1.5) 

8 

(1.3) 

100 

20 

(4) 

40 

(4.9) 

50 

(5) 

60 

(4.9) 

80 

(4) 

1000 

200 

(12.6) 

400 

(15.6) 

500 

(15.8) 

600 

(15.6) 

800 

(12.6 

10,000 

2000 

(40) 

4000 

(49) 

5000 

(50) 

6000 

(49) 

8000 

(40) 

100,000  20 

,000 

(126) 

40,000 

(155) 

50,000 

(158) 

60,000 

(155) 

80,000 

(126) 

If  the  binomial  distribution  accurately  describes  retention 
decisions,  the  confidence  levels  for  predicting  next  year's  retention 
rate,  given  this  year's  rate,  can  be  derived.  For  instance,  if  this 
year's  retention  rate  is  p,  next  year's  rate  will  be  between  p  +/-  2  PSD 
in  96  out  of  100  years.  For  p  =  .2  and  n  =  1000,  the  limits  are  .20  +/* 
.063.  For  p  =  .2  and  n  =  10,000,  the  limits  are  .20  +/-  .02.  Of 
course,  for  a  given  n  and  p,  the  size  of  the  bands  around  the  mean 
depends  on  the  confidence  level  with  which  the  prediction  is  desired.  A 
band  that  includes  99  out  of  100  predictions  will  be  wider  than  one  that 
is  accurate  in  only  90  out  of  100  predictions.  Table  2.2  provides  the 
percentage  bands  around  the  mean  for  different  n  and  p  combinations  and 
confidence  limits.  For  example,  referring  to  the  number  in  the 
fourth  column  (95  percent)  and  second  row  (p  =  .2,  n  =  1000),  the 
interpretation  is  that  in  95  years  out  of  100,  next  year's  retention 
rate  will  differ  from  this  year's  by  less  than  12.3  percent.  Thus,  in 
95  out  of  100  years,  p  will  be  between  .2  +/-  (12.3)(.2)  =  .2  +/-  .025. 

The  expected  accuracy  of  prediction  varies  strongly  with  the  number 
of  personnel  making  decisions.  At  the  95  percent  confidence  limit,  our 
accuracy  of  12.3  percent  is  expected  with  1000  people,  while  3.9  percent 
is  expected  with  10,000  people.  This  fact  has  implications  for 
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In  the  binomial  model,  the  magnitude  of  year  to  year  variation  in 
retention  rates  will  depend  on  the  number  of  people  making  decisions 
each  year  and  the  average  probability  of  a  retention  decision.  Taking 
the  standard  deviation  as  a  measure  of  the  expected  year  to  year 
variation.  Table  2.1  presents  the  expected  number  of  individuals 
retained  and  the  year  to  year  variation  for  different  group  sizes  and 
average  reenlistment  probabilities.  For  instance,  if  we  take  p  =  .20 
for  an  individual  first-term  retention  decision  and  100  individuals  are 
making  retention  decisions,  then 

M  =  .2(100)  =  20 

S  =  /l00(-2)(.8)  =  U 

The  mean  number  of  personnel  retained  is  20  and  in  a  sequence  of  25 
years  where  exactly  100  individuals  make  retention  decisions  each  year, 
we  would  expect  that  M  would  fall  between  M  +  O  =  2U  and  M  -  o  =  16  for 
17  out  of  the  25  years,  or  M  would  fall  between  M  +  2a  and  M  -  2o  in  2U 
out  of  the  25  years.  If  actual  retention  rates  in  a  series  of  years 
show  greater  variation  than  predicted  from  this  model,  it  is  likely  that 
nonrandom  factors  are  present  that  change  the  average  reenlistment 
probability  from  year  to  year. 

Another  measure  of  variation  is  the  percentage  standard  deviation 
(PSD)  given  by 


For  100  people  making  retention  decisions  where  p  =  .2,  the  annual  PSD 
is  20  percent.  The  PSD  declines  as  the  number  of  individuals  making 
decisions  increases.  For  p  =  .2,  a  group  of  1000  people  has  a  PSD  of 
6.3  percent,  while  a  group  of  10,000  has  a  PSD  of  2.0  percent. 
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II.  TESTING  FOR  THE  INFLUENCE  OF  NONRANDOM 
VARIABLES  ON  RETENTION  DECISIONS 


Each  individual  retention  decision  can  be  modeled  as  an  event  with 
two  possible  outcomes --either  stay  or  leave  the  service.  If  we  assume 
that  each  decision  is  made  randomly,  the  binomial  model  can  provide  the 
expected  number  of  individuals  retained  and  the  level  of  year  to  year 
variation  expected  in  retention  rates.  This  variation  represents  the 
minimum  year  to  year  variation  achievable  when  nonrandom  factors  are 
absent.  In  this  section,  we  will  compare  the  historical  accuracy  of 
year  to  year  continuation  rates  with  those  generated  by  the  binomial 
model  to  determine  the  extent  of  influence  of  nonrandom  factors.  The 
pattern  of  error  can  also  help  determine  the  factors  causing  the 
nonrandom  errors. 

A  SIMPLE  BINOMIAL  MODEL  OF  RETENTION  DECISIONS 

If  we  assume  each  reenlistment  decision  to  be  a  binomial  event, 
then  p  can  be  taken  as  the  annual  probability  of  retention  for  an 
individual  in  a  given  military  service: 


M  =  np 


o  =  /npq 

where  M  =  the  mean  of  the  binomial  distribution 
o  =  the  standard  deviation 

n  =  the  number  of  individuals  making  retention  decisions 
p  =  the  probability  of  retention  for  a  single  individual 
q  =  (1  -  p)  =  the  probability  of  retention  not  occurring  in  a 
single  trial 
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techniques,  but  on  the  ability  to  produce  timely  and  accurate  forecasts. 
Without  systematic  analysis  of  the  forecasting  records  of  models,  no 
basis  exists  to  choose  between  alternative  models  or  to  provide  a 
coherent  rationale  for  policy  choices. 

The  results  indicate  that  error  rates  vary  widely  according  to 
enlisted  group.  Certain  nonrandom  factors  contribute  heavily  to 
forecast  errors  for  enlisted  groups  with  3  to  10  years  of  service  making 
reenlistment  decisions.  The  pattern  of  these  errors  points  to  factors 
associated  with  the  economic  cycle.  These  factors  have  been 
incorporated  through  behavioral  models  into  enlisted  force  planning 
systems  since  the  early  1980s,  which  should  markedly  improve  enlisted 
force  forecasting.  Forecasting  records  for  other  enlisted  groups  show 
fewer  errors.  For  enlisted  personnel  with  11  to  20  years  of  service, 
errors  were  close  to  random.  Enlisted  groups  with  more  than  20  years  of 
service  showed  moderate  nonrandom  components.  Forecasts  for  attrition 
in  the  early  years  of  service  showed  nonrandom  factors;  however,  actual 
percentage  deviations  were  fairly  small--usually  less  than  3  percent. 

With  the  simple  continuation  models  tested  here,  the  expected 
accuracy  of  one-year  forecasts  is  extremely  good.  Maximum  error  rates 
occur  for  groups  with  2  to  4  and  20  to  30  years  of  service,  where  the 
average  forecast  error  is  less  than  10  percent.  For  other  groups,  error 
rates  are  generally  less  than  3  percent.  However,  this  accuracy  is 
somewhat  misleading,  since  only  about  20  to  25  percent  of  the  force 
makes  an  ETS  (end  of  term  of  service)  decision  each  year.  Error  rates 
for  three-  and  five-year  forecasts  are  much  worse  and  tend  to  show  the 
cumulative  effects  of  poor  forecasting  at  the  ETS  point.  Error  rates 
for  five-year  forecasts  for  the  hardest  to  predict  groups  in  the  early 
years  of  service  range  between  15  and  30  percent.  Patterns  in  error 
rates  among  the  services  are  remarkably  similar. 

Section  II  compares  errors  from  a  simple  forecasting  technique  used 
in  the  FY71-80  time  period  to  those  predicted  by  the  binomial  model  to 
determine  the  presence  of  nonrandom  factors.  Section  III  documents  the 
accuracy  of  the  simple  technique  in  predicting  the  size  of  various 
enlisted  force  groups.  Section  IV  describes  ways  of  improving  enlisted 
force  forecasting  and  the  implications  of  the  results  for  design  of  an 
OSD  enlisted  force  planning  system.  Section  V  summarizes  results  of  th- 
analys is . 
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In  developing  strategies  for  improving  manpower  forecasts,  the 
errors  can  provide  a  guide  to  which  groups  have  the  largest  systematic 
errors,  and  therefore  have  the  highest  potential  for  improvements 
through  development  of  more  sophisticated  behavioral  models.  The  error 
estimates  also  indicate  how  much  improvement  might  be  expected  from  more 
sophisticated  models.  The  simple  nonbehavioral  estimates  tested  here 
were  the  primary  technique  used  in  large  planning  models  during  the 
FY71-80  period.  Since  that  time,  the  services  have  begun  to  incorporate 
some  behaviorally  based  forecasting  techniques  for  certain  enlisted 
groups  in  their  planning  models,  which  should  improve  their  forecasting 
ability.  However,  many  enlisted  groups  are  still  forecast  using  the 
simpler  models.  The  analysis  in  this  Note  can  help  in  deciding  if 
appropriate  choices  are  being  made  for  using  the  more  sophisticated 
models . 

Knowing  the  level  of  random  and  systematic  error  can  also  improve 
policymaking  by  allowing  uncertainity  to  be  taken  more  explicitly  into 
account.  Knowing  the  level  of  uncertainity  allows  managers  to  hedge  in 
order  to  meet  manpower  requirements  with  a  given  degree  of  confidence. 
For  instance,  for  certain  critical  skill  requirements  where  shortages 
have  high  costs,  planners  can  efficiently  meet  requirements  with  given 
confidence  levels  if  the  likely  errors  are  known. 

Beyond  the  specific  uses  of  error  analysis  mentioned  above,  this 
Note  seeks  to  encourage  the  analysis  of  errors  as  a  central  part  of  the 
enlisted  planning  system  at  the  OSD  level.  Duplication  of  the  large 
models  used  by  each  service  in  their  planning  process  is  not  warranted; 
however,  careful  and  systematic  monitoring  of  the  manpower  forecasts  for 
each  service  and  analysis  of  errors  can  provide  the  proper  incentives 
for  the  services  to  improve  their  models  and  to  identify  unexpected  and 
perhaps  harmful  long-term  impacts  of  service  policies.  In  the  long  run, 
it  will  also  identify  successful  modeling  techniques  in  each  service 
which  might  be  transferred  to  other  services,  and  help  develop  an 
improved  base  of  common  forecasting  assumptions  across  the  services.  An 
example  of  the  latter  would  be  common  macroeconomic  assumptions  in 
forecasts.  Ultimately,  the  value  of  any  m  del  that  forecasts  manpower 
depends  not  on  the  sophistication  of  the  statistical  or  economic 
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statistical  fluctt  .ion.  Systematic  errors  in  manpower  forecasts  that 
change  these  average  year  to  year  forecasts  can  arise  from  multiple 
sources,  but  one  common  source  is  behavioral  responses  of  enlisted 
personnel  to  changing  policies  or  civilian  economic  opportunities  or 
changes  in  the  organizational  environment.  Estimates  of  the  level  of 
systematic  errors  can  be  obtained  empirically  from  historical  forecasts 
if  comparisons  are  made  between  simple  estimated  random  error  levels  and 
actual  changes  in  year  to  year  manpower  levels. 

This  Note  develops  estimates  of  the  errors  in  manpower  forecasts 
using  enlisted  force  data  from  fiscal  years  1971  through  1980. 
Statistical  assumptions  are  first  used  to  estimate  the  magnitude  of 
random  errors  in  various  kinds  of  forecasts.  These  forecasts  include 
projections  of  the  enlisted  inventory  for  each  service  by  years  of 
service  and  for  various  demographic  groupings.  Next,  the  empirical 
accuracy  of  a  simple--and  widely  used--nonbehavioral  forecasting 
technique  which  assumes  stable  year  to  year  retention  is  calculated  for 
one-,  three-,  and  five-year  forecasts  for  the  same  enlisted  force 
groups.  Comparisons  between  the  level  of  random  errors  and  actual 
errors  using  the  nonbehavioral  forecasts  allow  inferences  about  the 
level  of  systematic  errors  in  manpower  forecasts. 

Knowing  the  level  of  random  and  systematic  errors  in  various  kinds 
of  manpower  forecasts  can  aid  the  design  of  improved  enlisted  force 
manpower  models.  This  study  addresses  a  series  of  preliminary  questions 
that  need  to  be  addressed  prior  to  the  design  of  an  enlisted  manpower 
forecasting  system  for  OSD.  These  questions  are: 

1.  Does  the  historical  accuracy  of  simple  projection  methods 
indicate  the  need  for  more  sophisticated  techniques? 

2.  Does  the.  pattern  of  forecast  deviations  indicate  the  need  to 
incorporate  variables  tracking  economic  cycles? 

3.  Does  the  pattern  of  forecast  errors  indicate  which  manpower 
groups  need  more  sophisticated  models? 

4.  Does  the  pattern  of  forecast  errors  determine  an  appropriate 
disaggregation  scheme  when  forecasting  for  enlisted  personnel.' 
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I.  INTRODUCTION 


Manpower  forecasts  of  the  number  and  quality  of  enlisted  personnel 
who  will  remain  in  the  service  are  critical  components  in  setting  and 
changing  enlisted  manpower  policies.  Forecasts  that  show  persistent 
shortfalls  in  occupational  areds  result  in  increased  bonus  payments  or 
special  pays.  Forecasts  of  aggregate  manning  levels  are  used  to  help 
determine  the  annual  adjustments  to  the  basic  pay  tables  and  figure 
prominently  in  suggested  changes  to  the  military  retirement  system. 

Besides  these  obvious  direct  effects  on  compensation  policy, 
forecasts  also  play  a  prominent  role  in  estimating  and  allocating  annual 
budgets  for  compensation,  training,  and  recruiting  resources.  Each  year 
the  services  must  forecast  manpower  losses  ai.d  establish  accession 
requirements  sufficient  to  meet  Congress ionally  imposed  fiscal  year  end 
strengths.  These  accession  requirements --which  depend  on  forecasts  of 
losses--are  used  to  establish  annual  resources  for  training  and 
recruiting.  The  annual  compensation  budget  is  then  based  on  the  grade 
and  experience  distribution  of  those  remaining  as  well  as  the  number  and 
timing  of  new  accessions. 

The  efficiency  of  the  various  policies  established  on  the  basis  of 
manpower  forecasts  depends  critically  on  the  accuracy  of  those 
forecasts.  Inaccurate  forecasts  can  result  in  base  pay,  benefit,  and 
bonus  levels  higher  or  lower  than  necessary,  leading  to  either  a  surplus 
or  shortage  of  personnel.  They  can  further  result  in  inefficient 
allocations  of  resources  between  compensation,  training,  and  recruiting 
budgets.  For  instance,  predicting  a  higher  level  of  accession 
requirements  than  necessary  would  mean  unnecessarily  high  training  and 
recruiting  budgets. 

Errors  in  forecasts  are  usually  classified  as  either  random  or 
systematic.  The  level  of  random  errors  presumably  provides  a  lower 
limit  to  the  ultimate  accuracy  of  forecasts,  and  this  level  of  random 
errors  can  be  estimated  if  certain  statistical  assumptions  are  made 
concerning  manpower  decisions.  This  simple  statistical  model  would 
predict  stable  average  forecasts  from  year  to  year  with  random 
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C0f\Jrvjinr>-ir>r-»-r-  COO'£>»~C\jOCT'OrOvOrov0.3‘-3'r*">*-»- 
J>vCkTiC\J»“Oj»-*--*—  r~  T-  r-  r- 


C>Ov£>cDO'~*“'^'rir>^f\jr,-c7'f\iC'“C>r'»-jyina'^c\7GOr^-<c 
fOP-COf^flO^flOa-  —  OOOOP-flO'OCVJiT\«\i— Os^CMAnOCu^CO 


ro*-c0C0r'“-OfO00a'OO'(\jr0OC'O<'O'C00Os0O-^  —  Cu«- 
f"-  vO  a>  *-  CSJ  CVJ  *-  f-  t-  r-  *-  »-  *-  r-  f\j 


OlT'Or^-rOrO»,“»-00\O-^,C'C0C0f,OOC\J»— •^>-^kArorOi/N\C'OvO 
Ps-8OCsj'O»“'O00^P*-rO»~  f-krf^fNjr'rosO^iTvfVJrorsjCv^t  O  -7 
irMTio<\jOOvrMrN(\j*-\fsoo"0'<>'0^<viP*^vo^rsjr^a'j,-“ 


—  ^C40f\J'0-3'a'00{\J^OO'OfO'000»-^ON'OC\jf\Jf\J»-»- 

c-  c-  if\  <■»■>  oj  ru  ro 


so»-\OOoo^coooi^'-co*-aDr^fv^jo»-oo^^4P>*-\o^a'C 

ocvjr^a,>'-^'>o«^)-3-cor^O'^r^C'ooo^eo^'(Njj'j-r\j{Njj-rsj 

^0'Jfl0OP*O'0'#>r,*-^OP*,y’^^^C0»-«®ONr,«('j®O 


r\j  o  o  rv  80  *-  o  ^  'O  co  ^  ia  oo  f*i  f\i  •—  *— 

coinooro--'-*-'-'-  —  Co  oo  oo 


—  aOcOr-^i/Nroo^J,C>»~'~«OCTOO'— ^^700000^00^^-7^ 
0>-^O^vOf\jr^Or''COLrs^P~'^'CO-7J^Or^cO-^0''000>r<''~orj 


roCCC0r^P^»-CwC'C0rO»-O'Of^'sC0C.  •—  — 

VOO^  f>  f-  ^  r-  f-  ^  r-  f-  r-*--(\j{\j(\fOr> 


t-f\j8n47iT''OC'OOOOr-f\j^ri^kr',of^-cooc»“f\j'^.7kr''Xj,‘^7>‘,oc  c  *  < 
r-  r-  f*  r-  »-  r-  *-  r-  f\|  (\J  Cy  Cu  CO  Co  <\  C  .  «  \»  rn  M  -7  »- 

«  o 


JS.vjtf,.  >  .NJWNHJ/NO'J  IV  (JJJlIUUbilJtl 


1,484  991  645  580  375  490  332  322  676  547 

968  1,132  681  444  342  244  340  211  216  446 

3  75  529  486  263  42  28  28  46  44  75 

2,473  93  337  444  2,011  211  289  575  547  1,124 

624.979  599,734  571,750  529,058  503,176  479,624  469,874  469,847  458,953  456,202 


16 


fv;a'0vfoinco^oo>0'*-0"00^mfl0'-fs-fl0^rpor-o\»-ooooo/^r^f\1>j-o> 

OCOCOrv-rOLP\C\jiAiAvOr^-iArOir>^J-tn\OOoO^OO-3'C7'iOOOC*— C\J»~>-f\J 

rvjoo^rr-r-  —  j-cNjj-r^t^inoinojcrr-^ro^-r-vorsjoj^rrofooa'Cysoro 


\ocoiAso^Ofs'\ooN»-fo^-sofv‘r^oococoiA»-o\^vo(VkAOiA^-a,'C>-3-4r'f\j 

cocor~iAcocococoaoaNC>a»a'^'0«7>0\a'^vOvor,»-r,vcooois-r--r,^r-c\jiAr->oo 


C\JroCT\-3-roJ-NOOr*~C'i/>vOir>ir»ChOfO^(\jcOoO(NJ'y^C'f\JN.CT'OfVt^'CNJ«-vO 
ooir\Osf'o*-r^inc\j»-J-vooO'-0(\jh-r~ocoj-*-Ooo  —  «^r-fvjf\;irvflor^r^ 
'Ovoc\jr**ooir\fOcO'OoocovONOroa'j,r>-j’^oa^.^OMr»w,)fvj^rcoirs<Njj3-vo 


voa>«~**-coovnrooooc\jfOkA'or^p^cocoj,»rurvo,'OiA»-r\jflOkncyvj-  —  voo 

flOaOf“^iAflOflOCOODCOCT'0'CNC'^'^0'C'0'C'iAsO'Or,*»r«»flO'OsO'0'0<\/tA'OflO 


tAT-iAvO'Or^-^rcoj,oooiAfosooorof-^\0'«oooo<^)irN(\jij-(\jo,vflOC\i^yc\jr- 

’-'^DOO^OOJOLA{\jr~-^r^OJCOOrorOoOLA*-*-h'iAroO<^»— ^J>LT\»-J3-rO 

\OzyjjoiPiCOcoiriO\o^f^oor^4rr^iAkA»“foc\joc\j(\joo^^fOiA4j'jyf<)fo 


vOCOt^-»~^,O^OC\JOOOCNJpOiANON-l^*OOOO^f'iA^»-0\vO'“CMCOL'>r\jvO*-^0 

COCO'Oi-/>COCOOOcOCOO'C'^a'a'OvOsOa'C?MAsOf^'Of^-aOvOvO'Or*-^-^f^oO 


iA-3’CAa0roirNm^rLr>ros0C\l^?r^v0-5‘O»-*-»”Of\JfOCJ'-'O^)CNj’— CO»-'-CM 
JC\jiAQOfOOJ^i^OC>Of/>C>0'vOf\J^'-ts-CVJ'_(\JOf^iAir\CM>fOfOMCO 

#0^^fmf\jOj»-v£K>dOJ,»-»-^4?'0^flOOvOoOr^0^vOO',o-^OrjvD4rO 


vooocoo\oc\jm<\jO\«-roj-^vof^oooor-ONvocoirooLr\»-i-oof^»-^rrj 

COCOvOiT\GOOOCOCOCOOC7'C7NONONONOC>OOOiAvDr~-^OOOOvOr^h“f^-»-Jkr>flO 


o\pooo^oj-cor^^o«x>j-f~osr-^r»-oo^ro\ONO^r<\jiAoooo'-'OcMrNOooir» 

a'0'r^c\jr*-o^'“voOinj-oOOoooirsror-^ir>j-oo^rkr\r^-c3-j-r»'f-o-krNcoin 

COCVJO^rrOO\VOC\JvAO»-'-aOvOtf\0\*-rOt^'Cr-rOOO'-CT'^ysOC\jOlAf,-fO 


r^*-(M'OvOfO\OtAOO»-ro^iANOr^r^COr^v£)(\;vOC\i»-.O^Of^'COC\ja,O^Oa' 

cocoN£)irNoococooofl00c>oa'0^asONOosaOknsor»-r*-coooNOvOvor~-^^^r*» 


rOf\j^nO'NCCvJ5CON-70f<)CO(0\0'O^^^CON'“N4'0'Oa''-00'-r- 
r-.jmvOu'>^cTkr»vO00^y^(\Jv00N'^O^— kn^oroON^JTOirsCr-OviCV-a-^CNJ 
oof^-och^r»-co<o»-r^cvof<,i*-'0>>or^c\jc\jc>a"0»-ir'(\jocroflo*-ON»-c\i 


(\jJ'-'r'h-m\OinO(\]J-?0^r^r>-cOvO^O^OOOJCOCO^a'C\JiAOr' 

COf^-vOiT\aOCOcOCOOOOC>C7,'C>OOOC7\CO-3’Or^'Or^oOkA\C'OJ^»-ror^r~ 


(\0jN0kn^rO(,«0ur'a0c0’^or^rv-r\o^rOf-r\'jrc7'rs-'C0^oroccciJ^Oc0^ 

iT»(\iOfv-C\JC0<\jfs-^-^CCT'»-kAkAu'>^C0fM0NC0ir'C\jknrOO'^-^0''^C0^'“ 

^JOOtAM-“'Oir>cOiT"0^4JO'-'-0^u'>JOcO'-^r^f-^0>-^^ 


•~O-^(\lvD^T,r^'OO[\J^^vDfv'N-r^00f^vOC0Lr>(\1O'OCNJO^f\jr^0000O'«O 
COr^vOincOCOoOCOOC,'C>0'C^OOC7'OOCO^'Or^-r^-r~00\0'0'0'£)'— O'g'Of^ 


—  h-O'  —  vO«“COC>r-OOCor^'-0'COa'— —  f'-O^r-OCMA 
v0'OO0\'£)fl0s0'0f^\0c0or,~u>>»-c7v^(\jL/>r^j-Lr'r^-fl0C'0v,'-^Ckr'^r^r^o 
C'0oofs~-^,oof^*^fo«*ors-fs*r”-3'v0^>^r5vors^o0'^0'“»_'0^r^>t\i«^ror\jo*' 


joC’-jfO'Oi^O('j54vONN“N®Ncru/'jf-c\j>-c^f\j^t\j'ONcoif\ 

oovOvo-j,flOcooo«oONC'0'0'^'^0'C'^^'co^'vor^^^cov£5'£'«cr^rury'or~ 


OJ‘NO^*-'~cCOcOLrNOLr\f\;'sOCO^C'CiP'OLr>Cf^-0'^cC'_tV’^*— Ou’^iT' 

{\jpoiAforoc\jc-3-oot\i^ra'C\jr^'“-^'“r“00»-ONfooooot>^a>ONOoo^' 


ir\Ccoincvj^'Oir\OfouMrsvor^r-flOooooc\j^rf\jof^^flO>-j'a^osc\iOo*-^ 

CO'0'0^®CDCOCO(>t>^'CM>00'00'Ot>-30fs-NSS\0^0>0^!\<NN 


Ox^f-^^r-.s£jro-^cO'0'0»*-co^Oir\'^>trN^-0'ONOf^*vC’*-'C’0«v><\j<c-?»- 
iACOOO'rl'OC' •“  «-  »-*-  ^C>'-sCa'QO^r-sOrNjCvOJ>'^C  C  <K>  ^  O 

v0^rtff'Nf\/N»-r.N.wce01>jNO'i)CM«^OO^^<0t>N'-'-0COO 


rondOino^r,v-LrN*-rnj>iA^)r-r-aococo(Njr^sO'-tr'^rorvjr^r^^-3-c>*-o 

p^j\OrocooOooaOO^CT'^CT'0'C'^C^^O^vOr^-r^r-*cor-''£)r^^»o(\j*~-0 


♦  ^  -J 

*—  c\jro^4r\\or«ocoo»_<\)fw>-^ir'^^oPO'0»~f>j'v'-^^'i'r^  ©O'Ocr  < 

r-r-*—  r-r—  r-  f-  r~  r-  ^(\|C\J<\J(\jC\JC\ir'uCVi(\j(\|f*'‘fy''D*- 

o 


3Sf.  JXJ  M  JWNUiAOl.)  IV  tldJIlUUUUJU 


CONTINUATION  RATES  FOR  NAVAL  ACTIVE  DUTY  ENLISTED  PERSONNEL 


18 


o 

00 


<\jr^-r^OGOOl'^*iAf^<^>OOs»>r>r^*iArovO^ONvOOoOvr\'0^*'00^000*— OoO 
■3-<\|vOON*“OO.d-*-OCO-^(\J*-*-ir*C>r^rorO«3'NOmrOCT\CO-3,mOCVjr^OC\l 
vo^r^ra'Os(NjaDOsovOLnr-vo(\j^voooco^TO»-o^r-coj-r---o-'-Oro 


cOaD«-OvO.^CO^J'OOOcoro\OvO'Or-r^h»vOvOO»-S-(MOJr~ro^OfO*-0»- 
co«oc04ycor«-cococoooa\OOoCM>CT'ONaOir\fs-r,^r^cocor^coa'COJ,r^  co 


ON 


o,ocoinoN'0'0'~sor/>iA^*'-vovo»-oof^NO'Otr\voo*-r^oPo»~4tj-j,irNflo 

voO'ONroLrN-3Tor^r-oocor--r\jo(Nj^ovoc\jCMr\j“r«.r-oo^ofMvO<\ur> 

*-iAfOOv\O'OvOiA©.y^r'»ror«-»-»-COO\^,rO'£Oro©'0r-*COtO.3,'OOOa'r- 


OOf<NurvsOiACOCVjr*-r^fOr^ifMAf,^^f^^CVJ*“'OflOt\J^O'fOir\rocO*-*-0^' 

coO'CO^rr-r~cococooooOM>>oo'OOM>coiAsONor^r-r-r-r-ao'OTv,>NOooco 


co 


•-rorvj4?(\jr^'-Ov(\j(McOLr‘'--j-ooO'(NooiA'-c\jfM  —  foosao^roN^-r-r-®^ 
if>o>r>-'O^Tr^r^irNONkri»-r-cooo*“oo(\JO?«*)cumoo©invOirNOjr«-irMfN<\jc\j*“ 
»-rOcOzJ-(\JO"0(\JsOO‘^ONOO>OirNO'^J'r-0\J’4j,vO'Or^JcO»-©»-<v>CVJf^ 


cOON*-0'©v£>r^»“^vO<OJ-iANO'0'Or-rN»f\.'iA(\jr^OvOOOJOOf,*-0'.3‘Ofs-»- 

aooocoj,oor-eooooocooc7'ONONONCNONONaoir\vosOf^p^oof**r>«ofs“C\i»r\r-oo 


irvr'-u^irNOOirspoojoj'-  *-  ^ooo^foO‘ir\poroc\j»-ooiy(\;por-  ^oo'^o^’ 
covocNjoocovoor^inr-^y^cor^'— u^u'^4?'0'T»,5cor^-(v-yo.i-^'0^'OOjN£>EOtpt 

r*-  0'coONONC>fo^TCM^cvir^ir»&'Oorooorsjooo^*“»-irNcoj’OJcoo^,NOOir\ 

. . . 

NOco«w^O'NO,rNO'Oir\eo<*N**’i^vOf'**r'-P'»irvr'-f,'“r'-ON«v,>aoO(\j'0©irsirN'Of''>cvj 

oococc^cor~cocococooo'00'000'OvOLAvOvor^r-.cor^r^-c>r^-c\j4J-coco 


vo 


co^voo^r-~c-~r-f\ju^^rruvorsjj-oomco'“Oroj^j-ooot\jc\j^of\j 

^vOOr'O'OfOOvOLTivOcOOOPOOvOrO^roOOvvOf^VOr^r-CNJOr^CvjrvJflOiA^ 

*-r'-coOf-roc\jiA*-'or''OOiAr\jr-for^e-(\jco-3-c\JO'OC\jovoc\jf,oir\-3,c\jvo 


^0'^j-r-ov'0©vor^<o<oj-iAvof^f^t^^r^j-irvvoooj,fl0^rr^inc\jLA©^r»oov 

cor-^a-cor^ovoooooo0'c>00'0'00'0\vovnv0'0r^h-oor*-r^oois~(\jir»r^r- 


lT\ 


C\iiT\rnOyC\lC\(\Oa\(\jmClOr^r^r^^T^TCOOr^)C\iO'OD^D^TCOr^{r>'-’~Om 

c\imoopn\ocoovirvf^rocr»-^TavcoO'OOvoj-J'»-ooin©vO’-in»“*^^j,J'j' 

^^f*~rO^-vOco^roO'OOOvvo^rir«TOf'JOv'OOOvOls-ror*~rs-COOv^-»-ir'0'CO 


^OOvOiAO'if>^CO»-»--^^v0^^rs“r^fMO©(NJvOC\JCOf^C\J*-rOPOr,-©Or«- 

®NvO^CD^'OfOC>0'C7'^0'OOC't>0'OiA'£)vONNCO^OOCO'0'--3'^N 


POvOiAP*-POOv©C0r^fOvO0vO'*^kArOiTsPO^v0,,<>r#,>rr>ir\«— vOOvvOOO(M'“CMflO 

oofO'0(\jC'vo©(\jcoeoinc\;  —  *-<\ioo*-oao*-co«-r-wvo»-'OCM.3-jj'--©coco 

f-fONor^jyqorvjOj^yrocMr^^rr^poiri^TCvj^covoovcooofo^JCf^cjoor-iAvo 
o-  ........  . 

Oirirvj^irMnoo©<-^r^,vor-r-'or-^>c\jcoovO'-o^ro©j-rovOTo  —  so 
cor^iv-.^fl0h-ooooo0'0'0'0v(7v0'a'0'0"0j,'0'0r>-coo0^oocors-r\;^r^r^ 


(M^^NO*-<\jirvzrcoeofvjOfnd,0'»-»-»-oo'oo'o^O'.^^J,0‘0''“0'0©Lr\ 
\OOvfO'0(\it,,“'Or,^roiroO'vNvo^f-0'oor~-^zyfsj'“fvj*“^-iAb^'r^r-vor,~voOoo 
ro  h-CO»w^»~TOCyNJ>OLrN(\jro\OONfr>^,—  C>C\JfOvOOCO^'r^^OO,'rOLOf\J',-r)0^~ 

. 

Mii>5J*-fOScoOO^^vor*-P'SNJ^(OJCOr'P'roiriOoDOj^f<)ON 
oor^oorooor^flocoa'a'a'0'0v0'0v0'0'0"03,v0\op-r^oop-aooo«of\i^y  r- 


(\J 

r~« 


irNr~*P^OrOOvCJ^^J,'OvO'0  —  f-'OrO«OirNvOOvfs-0©C^’(MvOirvcO©^-Or- 
^irv^oor^ir\vOQD©for*-krNvn<'ooOfs-<M»/vf,oO'vr\»“©vofMOO^'0--^-^oo 

oo4r^in^*-^r  —  or-iK-ao^NcoOO^r-^j^j-of\jcoj-0'(X^co^  —  cooo 


^fr~LfN\OTvNvOOOCO>-'-i/>'Of^*^-COOCOOvO*-Oi/'OvJii>^-vO'-CMOT--irOr-OJ' 
COOCOC\JCOr~COQOC7'0'ONOO,'0'00NOOv^Lr\vOr^r^COOOOOCOCOCOrOrO  r» 


r^oO<*,»OjvO-OCOOOJvOOOOOOirii/NOjf*n\O^Jf'JfVj©roro^PO^J^tJ,(\jOOO 

ojr^-^f^oooov^»”0'oood^-ovvooj,vO',OLrN*-f\jiro^<-'irivo>“rvjTOO'0 

f\jcoifjyvrvifpofoiAO,'^'Oi/>o-0'^i^r,,~^y'Oco^r**rvj^cviiA^o^c\j^O'0 

ir\p^4jr-NOco^oOirNLrN^of^^^oosOiAr-ror^ror-zrr*-)'^ocO(\j--Oir\ 

CO‘OCOfU«0<OCO(OcOOTO'0'OvO'OvONOvONvOJ-vO'Or-r-OO^P-OCOOCNj- 


a: 

< 


10 

o 

> 


f  *  — I 

•-  ir  O'  c  o  z  < 

r~  r-  r-  r-  r-  r~r-(\|{\j(\M\jf\j'\jf\j<\|<\  Oil  r>'  ^  3  ►•• 

o 


JUA J  AN3WN«JA0y  EV  UJJIIUUMd  )>< 


81. 596  83.980  84.382  83.751  81.165  86.131  86.044  86.182  89.166  88.723 


-  19  - 


rjf-cvj>ovoo\CNjfooor^co^*Os»-^^ONfo«-fo^ro^floa'CO«or^pocooc\j 

ovOro^c\jf^p^o^poOf,o<vrv;v^or^-vo^4r\<,oiri-3-'i£)i/>u^r-rovo*-04?- 


<0«NJ(\J-^^t\JiTNCOr-fO(\JsOiACOflOONa'r^rOOlA^it'OONPa»-fs**-4fOCO 

®r*-^f-*®®®®ovovOO'OvO'^OvOvOv'Or-r^r-«o®r'»®®©ir».tf 


O-3,C>J,sOO00u[>fOOC\J^»-0NJC\l®^'for-^C\jroOvOCgir\O»-'OO*- 

CO»-CO'OiAr^(\i'*>*-CVjaHro^i/>tf'vOOtf,NPyjvOifN'ONOO'i©.3-«*,‘»-©r-f">©'0 

^•^o-3-cO',ofv»-^j-vOiA^'^r©rotnco<oiriOeo4yir>iA4risoino«ooco 


Ofooo>Or-csjpor^©c\j»-in/M^©ooaO'0.3,»riCsitr\fvir«-irNiAj,rj^-irN©r- 
o,r^r<3r^coaocoaoco^CT'^c>a'050c>krN'Of^-f^<D®p^r>-coaoJTJ'  f¬ 


o^r-f^a'^o^or-»-rooinzr»-f\jror-kAr-(Njoofsja'^oocoj“^'Ofo 

*-'OOvOh-^rr->*-cr«sO-3-OOr^oOin©r^^'0»-'-J-oo*-^r>-^coojj 

*-Or-©©irMr\CJ©CNJ©r^r-'0P0f0r-f0v0r^CVjOa>C\J-3,O(\Jfs“fViJ,©N0 


a'COc\ir^©r^-soO'f^o^J’'©'Or~oo©r^'irivoj-\oiA^yoo^*-r^roiriOcr 
cO'Ofor^r^-r^h~r^ooa'OOC7NOC7NOOCTMAsOh-r^N.©r^co®rs-CMro  r*- 


ro\T>C7'iT\»-r^C0ro00v0'~C\JJ,'^O,~r,,,>»-C7''^>vOlAO'OrOOa'ir>CM»-OO 

o©o®fsjoc\jNOcgror^ror*-^Tinoor^-a,vo©irN»-r^sO(\jfo®'oa'^j,o^y 

0\5fOOJ«5fOJfOr‘f-f*flO'iOON^'00'»-(\J<OOM^W®'N-^NOO 


ou^sor^-c>o^(7'00''-«v^.3'^r^^r»-covo«Ofw^Lri^'iAr~-'OcO'>ot>o©^- 
eof'f/>r^r*Nr^h-NflOC>c>c>^^0'(?ioOir\\OSf*-Ncorfcfs‘r«<o»-j  r» 


r-OJ^Lri{\jONC\iJjOO'fONC\ir-.rOO'OiAr-r--rorO*-r*-OroOOO(7'©iA 
coa'po47*-knr^vo^r^^,(\j^yoc\jf^vo*-©a^ovr)»-rop^^j-oco©^rooj 
ooa'ONO*-rdOror»-o^y^^vOa'irico©j-©f\icoN-®o  —  J-’-Ovooru 


®«-r-coc><\j>oo  —  ©^-*coif\so>oh-r-.so^a3ro^.^-kr\r«-(\]oo(\jiA€0©vo 
r^r^for^r-co®cooo^OO'ONO^O'C>QOLr\vOf^r^cocor^-cor^r^c^j’  r- 


<\i^,in0\Ou>#,0<Mir>©0\r~r'(\jr^^rj-©ofl0fl0'0’©v0r^-'-''0®r-j3-o® 
vO(M'OkAC7'0^ovJ4r\r-or>-c>-3-r^^rokno>^r05^0©0'~rof^O'-Q(\j 
OO^tfN©r*-0'NO*-CO'OOflOO(\JO\MiAknO\»-flO'”  ONflOO^NOr- 


v0^0N«0*-foirv»-'-a'©'OJ3,-3,'0'0'0^'iAr^»“00kn*-o*-'p-^rir\vr\o*“ 

®  vO  rO  r«»  ®  ®  ®  ®  ®  ®  O' O' Ov  O' O' O' ® U"\  vO  r**  P*- ®  vO  vO  vO  (M  r*>  h- 
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Table  2.13 

OVERALL  CONTINUATION  RATES  FOR 
DOD  ENLISTED  PERSONNEL 


Marine  Air 

Army  Navy  Corps  Force  DoD 


1971 

51.1 

1972 

68.4 

1973 

72.9 

1974 

73.3 

1975 

74.8 

1976 

76.8 

1977 

79.9 

1978 

78.1 

1979 

78.7 

1980 

81.7 

75.7 

62.6 

74.6 

67.5 

77.8 

69 . 3 

76.7 

72.3 

77.8 

71.1 

79.6 

76.2 

82.6 

77.6 

81.7 

74.6 

81.2 

77.9 

81.3 

78.4 

82.1 

66.1 

80.1 

73.5 

80.2 

76.0 

81.5 

76.4 

82.1 

77.2 

83.9 

79.4 

86.5 

82.1 

84.2 

80.3 

84.1 

80.7 

85.7 

82.3 

required,  and  increased  the  proportion  of  the  force  with  longer 
commitments.  In  addition,  the  average  length  of  the  first  term  of 
service  was  further  increased  by  the  volunteer  force  policy,  which 
completely  eliminated  two-year  draftees  and  offered  more  attractive  pay 
and  training  opportunities  for  longer  commitments. 

First-term  retention  rates  have  also  increased  dramatically  since 
FY75  because  volunteers  enter  with  more  taste  for  service  life.  These 
factors  led  to  higher  overall  force-wide  continuation  rates.  The  higher 
continuation  rates  are  dramatically  illustrated  by  tracking  individuals 
who  entered  in  FY71-72.  During  this  period,  enlistments  could  be 
classified  as  draft-motivated  or  nondraft-motivated  depending  on  an 
individual's  lottery  number.  Table  2.14  shows  the  percentage  of 
individuals  left  in  service  from  those  FY71-72  cohorts  As  the  data 
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Table  2.14 

PERCENTAGE  OF  FY71-72  ENLISTED  ACCESSION  COHORTS  REMAINING 


Years 

Since 

Accession 

High  School  Graduates 

All  Enlistments 

Low  Lottery 
1-90 

High  Lottery 
271-366 

Low  Lottery 
1-90 

High  Lottery 
271-366 

1 

88.6 

87.3 

86.9 

84.5 

2 

74.7 

87.3 

72.1 

70.5 

3 

59.5 

61.2 

56.5 

55.3 

4 

33.0 

39.1 

30.3 

34.8 

5 

17.6 

25.1 

17.1 

22.3 

6 

15.8 

22.6 

15.3 

20.1 

7 

13.6 

19.9 

13.2 

17.6 

8 

11.4 

16.9 

11.0 

14.9 

indicate,  volunteers  (high  lottery  numbers)  have  significantly  higher 
long-term  retention  rates  than  do  draft-motivated  personnel.  These 
higher  retention  rates  have  in  turn  contributed  to  lowered  accession 
requirements  (see  Table  2.15).  The  lower  accession  requirements  for  a 
given  force  size  enable  the  services  to  raise  enlistment  quality 
standards,  and  will  be  particularly  important  to  maintain  during  the 
coming  decline  in  the  17-21  year  old  population  pool  and  improving 
economy. 

Overall  continuation  rates  for  the  four  services  generally  follow 
an  upward  trend,  with  the  most  pronounced  trend  being  for  the  Army  and 
Marine  Corps.  These  services  were  most  affected  by  the  Vietnam  build¬ 
up  and  the  influence  of  the  draft.  However,  even  the  Navy  and  Air  Fore-’ 
show  a  higher  overall  continuation  rate  after  1976--mainly  due  to  the 
higher  reenlistment  rates  of  volunteers. 
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Table  2.15 

NONPRIOR  SERVICE  ENLISTED  ACCESSION  LEVELS 
(Thousands  of  personnel) 


Fiscal  Marine 


Year 

Air  Force 

Navy 

Corps 

Army 

DoD 

71 

96 

78 

56 

314a 

544a 

72 

86 

87 

58 

187b 

418b 

73 

94 

95 

52 

216C 

455C 

74 

74 

79 

48 

182 

383 

75 

76 

101 

58 

185 

419 

76 

73 

93 

51 

180 

397 

77 

73 

101 

45 

168 

387 

78 

68 

80 

40 

124 

311 

79 

67 

80 

40 

129 

315 

80 

72 

68 

42 

158 

360 

81 

77 

92 

41 

118 

328 

82 

68 

80 

38 

120 

306 

g 

Includes  2,064  inductions. 

^Includes  156,075  inductions 

C. 

Includes  35,678  inductions. 

One  effect  of  the  end  of  the 

draft  and 

the  higher  volunteer  era 

reenlistment  rates  has  been  a  structural  change  in  the  distribution  of 

service  personnel  by  years  of  service  experience  (see  Table 

2.16).  For 

total  active  enlisted  personnel, 

the  mix  of 

junior*  to  career  personnel 

has  shifted 

from  a  61/39 

mix  to  a 

58/42  mix. 

Perhaps  more 

important  is 

*We  have  defined  junior  level  personnel  to  be  those  in  the  first 
three  years  of  service. 
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Table  2.16 

PERCENTAGE  OF  ENLISTED  PERSONNEL  IN 
YEAR  OF  SERVICE  GROUPS 


VuS 

72 

74 

76 

78 

80 

DoD 


1-4 

61.2 

60.7 

58.9 

58.2 

57.6 

5+ 

38.8 

39.3 

41.1 

41.8 

42.4 

5-10 

14.8 

16.9 

20.8 

22.0 

23.1 

11+ 

24.0 

22.4 

20.3 

19.8 

19.3 

Army 

1-4 

65.7 

67.4 

64.0 

61.8 

60.3 

5+ 

34.3 

32.6 

36.0 

38.2 

39.7 

5-10 

15.2 

15.3 

20.3 

22.0 

24.0 

11  + 

19.1 

17.3 

15.7 

16.2 

15.7 

Navy 

1-4 

62.3 

59.5 

57.9 

58.8 

57.9 

5+ 

37.7 

40.5 

42.1 

41.2 

42.1 

5-10 

15.0 

17.4 

20.9 

21 . 7 

23.0 

11  + 

22.7 

23.1 

21.2 

19.5 

19.1 

Narine 

Corps 

1-4 

75.1 

74.8 

74.3 

74.5 

72.1 

5  + 

24.9 

25.2 

25.7 

25.5 

27.9 

5-10 

11.4 

13.8 

15.8 

15.9 

18.0 

11  + 

13.5 

11.4 

9.9 

9.6 

9.9 

Air 

Force 

1-4 

51.1 

48.7 

47.2 

46.5 

47.9 

5+ 

48.9 

51.3 

52.8 

53.5 

52.1 

5-10 

15.0 

19.3 

23.3 

24.6 

23.8 

11  + 

33.9 

32.0 

29 . 5 

28.9 

28.3 
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the  dramatic  change  in  the  structure  of  the  career  force.  Younger 
career  personnel  with  5  to  10  YOS  have  increased  from  14.8  to  23.1 
percent  of  the  force,  while  the  percentage  of  older  career  personnel  has 
declined  from  24.0  to  19.3  percent  of  the  force.  Each  of  the  services 
shows  similar  trends  in  both  first-term  career  mix  as  well  as  the  mix  of 
junior  to  senior  level  careerists.  In  the  absence  of  policy 
intervention,  the  higher  reenlistment  rates  of  an  a  1 1 -volunteer  force 
essentially  provide  a  larger  career  force  than  does  a  draft.  Two 
advantages  of  this  mid-career  bulge  is  the  greater  selectivity  available 
for  NCOs  or  the  potential  to  use  this  bulge  as  the  base  to  build  a 
larger  force  size.  It  also  raises  an  important  policy  issue  of  how  many 
individuals  should  be  continued  to  retirement. 

Retention  rate  differences  by  YOS  (Tables  2. 3-2. 7)  show  fairly  well 
known  patterns.  In  the  first  two  years  of  service,  retention  rates  are 
determined  by  attrition  prior  to  end  of  term  of  service  (ETS).  This 
attrition  is  primarily  determined  by  the  quality  of  the  enlistment 
cohort.  Attrition  tends  to  be  higher  in  the  Army,  where  quality  is 
lowest.  For  DoD  enlisted  personnel  since  1977,  first-year  attrition  has 
been  between  13-14  percent,5  while  second-year  attrition  has  been 
between  10-12  percent. 

Continuation  rates  between  3  and  12  years  of  service  are  dominated 
by  first-,  second-,  and  third-term  reenlistment  decisions.  The  lowest 
continuation  rates  are  experienced  at  the  first-term  decision,  which  can 
occur  as  early  as  the  end  of  the  second  year  and  as  late  as  the  sixth 
year.  This  reenlistment  behavior  is  more  clearly  shown  if  continuation 
rates  are  calculated  only  for  those  individuals  having  an  ETS  during  the 
year  (see  Table  2.17).  For  DoD  enlisted  personnel,  these  continuation 
rates  generally  rise  between  3  and  20  years  of  service,  illustrating 
both  the  effects  of  self-selection  and  the  pull  of  the  military 
retirement  system. 


*First-year  attrition  is  somewhat  underestimated  here  for  the  first 
year  only  because  some  individuals  enlist  and  leave  during  the  fiscal 
year.  These  individuals  do  not  appear  on  our  file. 
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The  continuation  behavior  of  groups  with  3  to  19  YOS  not  having  an 
ETS  (see  Table  2.18)  shows  stable  and  high  continuation  rates.  Once 
past  the  first  term,  non-ETS  separations  can  occur  by  death,  disability, 
hardship,  AWOL,  or  nonsatisfactory  service.  Attrition  of  this  type  is  a 
small  proportion  of  overall  losses,  and  probably  has  only  small  non- 
random  components.  Continuation  rates  fall  at  20  YOS  with  retirement 
eligibility  and  are  fairly  uniform  across  services. 

STATISTICAL  TESTS  FOR  THE  PRESENCE  OF  NONRANDOM  FACTORS 

A  common  method  used  by  manpower  analysts  to  forecast  the 
population  of  a  manpower  group  is  to  disaggregate  the  group  into 
"homogeneous"  subgroups  and  assume  a  future  retention  or  continuation 
rate  equal  to  the  rate  for  the  previous  time  period. 

pt  +  1  _  j-  pt  t,  t-1 
E  -  I  Pi  fj 

population  of  group  in  time  period  t  +  1 

population  of  homogeneous  subgroup  i  in  time  period  t 

retention  rate  of  subgroup  i  between  time  period  t 
and  t  -  1  . 

The  underlying  assumption  of  this  technique  is  that  homogeneous 
groups  can  be  found  for  which  retention  rates  are  stable  over  time  and 
are  described  by  a  distribution  like  the  binomial  distribution. 
Differences  in  retention  rates  between  subgroups  are  recognized,  but 
retell*  ion  rates  are  assumed  stable  over  time. 

Probably  the  sole,  advantage  of  this  type  of  model  is  its 
simplicity.  Forecast  .rig  from  this  model  requires  only  personnel  rotor:;*; 
from  two  previous  years  to  calculate  r  and  a  current  population  pro! i  V. 
In  military  manpower  applications,  the  force  is  typically  d  i  sagg  re,;  i ;  ■■ 
by  demographic  characteristics,  educational  and  mental  categoiy,  u  I 
MI'S.  Retention  rates  similar  to  those  displayed  earlier  are  then 


where 


,t+l 


P*  = 
rj*  t'1  = 
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Table  3.3 

FORECASTING  ACCURACY  FOR  NAVY  ENLISTED  PERSONNEL  UNr  :.R 
SIMPLE  CONTINUATION  RATE  ASSUMPTION 


Mean  Absolute  Percentage  Error/lOO 


Years  of  One  Year  Three  Years  Five  Years 

Service  71-80  76-80  72-77  72-75 


1 

0 

.020 

0 

.016 

0 

.  175 

0. 

.267 

2 

0. 

.036 

0, 

.037 

0, 

.  187 

0, 

,227 

3 

0 

.064 

0 

.044 

0 

.  160 

0, 

.  188 

4 

0, 

.086 

0, 

.056 

0 

.  145 

0. 

.119 

5 

0 

.037 

0 

.052 

0 

.053 

0, 

.090 

6 

0. 

.022 

0. 

,018 

0. 

,067 

0. 

141 

7 

0, 

.012 

0. 

,010 

0. 

.064 

0. 

.  124 

8 

0. 

.019 

0, 

.029 

0. 

.062 

0. 

.096 

9 

0. 

.015 

0. 

.014 

0. 

.036 

0. 

065 

10 

0 

.013 

0. 

,010 

0. 

.028 

0. 

.059 

11 

0 

.005 

0. 

,001 

0. 

.021 

0. 

.052 

12 

0 

.009 

0, 

.006 

0. 

.020 

0. 

.033 

13 

0. 

,007 

0. 

.006 

0. 

.015 

0. 

020 

14 

0, 

.005 

0. 

.003 

0, 

Oil 

0. 

040 

15 

0. 

.004 

0. 

004 

0. 

Oil 

0. 

242 

16 

0. 

.005 

0. 

,005 

0. 

.036 

0. 

220 

17 

0. 

.002 

0. 

.001 

0, 

.  186 

0. 

.203 

18 

0, 

.010 

0, 

,010 

0. 

.  156 

0. 

.  194 

19 

0. 

,067 

0. 

,070 

0. 

.  125 

0. 

196 

20 

0. 

,049 

0. 

053 

0. 

104 

0. 

164 

21 

0. 

.044 

0. 

,052 

0. 

081 

0. 

113 

22 

0. 

032 

0. 

,024 

0. 

063 

0. 

133 

23 

0. 

.035 

0. 

,037 

0. 

.049 

0. 

105 

24 

0. 

.038 

0. 

043 

0. 

.084 

0. 

111 

25 

0, 

.025 

0, 

.024 

0. 

.099 

0. 

193 

26 

0. 

047 

0. 

035 

0. 

055 

0. 

510 

27 

0  . 

044 

0. 

046 

0. 

145 

28 

0. 

,039 

0, 

061 

0. 

566 

29 

0. 

.095 

0. 

089 

30 

0 

,  226 

0, 

,  187 
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Table  3.2 

FORECASTING  ACCURACY  FOR  ARMY  ENLISTED  PERSONNEL  UNDER 
SIMPLE  CONTINUATION  RATE  ASSUMPTION 


Mean  Absolute  Percentage  Error/ 100 


Years  of  One  Year  Three  Years  Five  Years 

Service  71-80  76-80  72-77  72-75 


1 

0. 

.039 

0, 

.017 

0, 

289 

0, 

,265 

2 

0, 

,  131 

0, 

.031 

0. 

138 

0. 

.202 

3 

0. 

.  109 

0. 

.083 

0, 

122 

0, 

.  194 

4 

0. 

,076 

0, 

.065 

0, 

122 

0. 

.172 

5 

0. 

.020 

0, 

.016 

0. 

085 

0 

.  107 

6 

0. 

.017 

0. 

.013 

0, 

051 

0 

.034 

7 

0. 

,019 

0. 

.030 

0. 

022 

0, 

.028 

8 

0. 

.023 

0. 

.029 

0, 

033 

0. 

.037 

9 

0. 

.013 

0. 

.012 

0. 

033 

0. 

.042 

10 

0. 

,012 

0. 

.013 

0. 

029 

0. 

.033 

11 

0. 

009 

0. 

010 

0. 

028 

0. 

.025 

12 

0. 

008 

0. 

007 

0. 

019 

0. 

,013 

13 

0. 

.007 

0. 

007 

0. 

012 

0. 

012 

14 

0. 

005 

0. 

006 

0. 

007 

0. 

010 

15 

0. 

,004 

0. 

.007 

0. 

009 

0. 

018 

16 

0. 

004 

0. 

,004 

0. 

010 

0. 

188 

17 

0. 

,003 

0. 

,005 

0. 

009 

0. 

.  194 

18 

0. 

,002 

0. 

,001 

0. 

121 

0. 

,  192 

19 

0. 

.002 

0. 

,001 

0. 

083 

0. 

.  187 

20 

0. 

.071 

0, 

.053 

0. 

096 

0. 

,226 

21 

0. 

,051 

0, 

,024 

0. 

126 

0. 

250 

22 

0, 

.051 

0, 

.035 

0. 

141 

0. 

.307 

23 

0. 

,035 

0, 

,025 

0. 

156 

0. 

,357 

24 

0. 

.046 

0. 

,030 

0. 

155 

0. 

374 

25 

0 

.026 

0. 

.025 

0. 

157 

0. 

,396 

26 

0 

.046 

0, 

.056 

0. 

159 

0. 

,332 

27 

0 

.044 

0 

.017 

0, 

145 

28 

0 

.037 

0 

.022 

0, 

604 

29 

0 

.071 

0 

.039 

30 

0 

.  338 

0 

.384 
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Table  3.1 

FORECASTING  ACCURACY  FOR  DOD  PERSONNEL  UNDER 
SIMPLE  CONTINUATION  RATE  ASSUMPTION 


Mean  Absolute  Percentage  Error/ 100 


Years  of  One  Year  Three  Years  Five  Years 

Service  71-80  76-80  72-77  72-75 


1 

0. 

027 

0. 

009 

0. 

142 

0. 

276 

2 

0. 

.077 

0. 

,028 

0. 

174 

0, 

208 

3 

0. 

064 

0. 

053 

0. 

,  147 

0. 

,  152 

4 

0. 

081 

0. 

.070 

0. 

.112 

0. 

.111 

5 

0. 

,018 

0. 

,017 

0. 

,039 

0. 

,063 

6 

0. 

,013 

0. 

015 

0. 

.044 

0. 

.063 

7 

0. 

,012 

0. 

,017 

0. 

,029 

0. 

,061 

8 

0. 

013 

0. 

020 

0. 

024 

0. 

050 

9 

0. 

007 

0. 

009 

0. 

021 

0. 

044 

10 

0. 

006 

0. 

003 

0. 

016 

0, 

.034 

11 

0. 

,005 

0. 

,005 

0. 

,013 

0. 

024 

12 

0. 

003 

0. 

,003 

0. 

.009 

0. 

Oil 

13 

0. 

,003 

0. 

,004 

0. 

.005 

0. 

.005 

14 

0. 

.002 

0. 

,002 

0. 

.005 

0. 

019 

15 

0. 

,001 

0. 

,001 

0. 

,005 

0. 

.081 

16 

0, 

.002 

0, 

,002 

0. 

.014 

0. 

193 

17 

0. 

.001 

0. 

,001 

0. 

.066 

0. 

.173 

18 

0. 

.004 

0. 

,004 

0. 

.110 

0. 

.  135 

19 

0. 

.019 

0. 

.024 

0. 

.082 

0, 

.116 

20 

0. 

.046 

0, 

.047 

0 

.068 

0 

.115 

21 

0, 

.035 

0. 

.044 

0, 

.029 

0, 

,086 

22 

0. 

.025 

0. 

,041 

0. 

,048 

0. 

,099 

23 

0, 

.024 

0, 

.031 

0. 

.096 

0. 

.  152 

24 

0, 

.035 

0 

.035 

0. 

,084 

0. 

,  186 

25 

0. 

.026 

0. 

,028 

0. 

,051 

0. 

167 

26 

0 

.047 

0 

.037 

0 

,  101 

0, 

.690 

27 

0 

.044 

0 

.048 

0, 

,  133 

28 

0 

.059 

0. 

.065 

0 

.  750 

29 

0 

.074 

0 

.055 

30 

0 

.235 

0 

.173 
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A71*79  -  I 
i  9 


9 

I 
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76>79  a  JL  £  (E1  I 


For  a  one-year  forecast,  two  time  periods  have  been  summarized--FY71-79 
and  FY76-79.  The  latter  time  period  removes  the  effect  of  draft- 
motivated  personnel  on  first-term  retention  decision,  and  thus  may  be 
more  indicative  of  accuracy  in  an  all -volunteer  environment.  For  three 
and  five-year  forecasts,  the  summary  statistics  are  given  by 


t72,77 

i 


T72,75  =  I 
i  4 


4 

Z 

J-l 


Tables  3.1  through  3.5  provide  the  forecasting  errors  by  service  and  fo 
DoD  personnel. 
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FORECAST  ERROR  FORMULAS 

Forecast  errors  for  one-,  three-,  and  five-year  forecasts  for  the 
simple  models  can  easily  be  derived  and  are  given  as  follows: 


Ci,j  ~  Ci,j+1 
Ci,  j+1 


where 


E.  .  =  error  for  the  n  year  forecast  of  service  cohort  i  in  yea 
i.  J  * 


C,  .  ~  continuation  rate  for  service  cohort 

i.J 


i  n  yea  r  j 


Essentially,  the  above  equations  forecast  for  1,  3,  or  5  years 
using  continuation  rates  from  a  given  year,  and  then  compare  the 
forecast  to  the  actual  number  of  personnel  present  in  the  forecast  year 
Estimates  of  forecasting  accuracy  can  be  made  with  the  KY71-80 
data.  For  a  one-year  forecast,  estimates  of  accuracy  can  be  made  for 
FY71-79.  For  a  three-year  forecast,  estimates  can  be  made  ior  FY71-77, 
and  for  a  5-year  forecast,  estimates  can  be  made  for  FY 71-75.  Rattier 
thar  provide  forecasts  for  each  YOS  group  for  each  service,  summ.n  v 
statistics  have  been  compiled.  The  mean  absolute  percentage  error  hr. 
been  used  to  summarize  the  data. 
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III.  HISTORICAL  FORECASTING  ACCURACY  UNDER 
SIMPLE  CONTINUATION  ASSUMPTIONS 


-j 


The  results  of  the  previous  section  imply  that  the  presence  of 
nonrandom  factors  is  the  dominant  component  of  forecast  errors,  but  the 
amount  of  influence  of  nonrandom  factors  varied  considerably  depending 
on  YOS  group  and  degree  of  disaggregation.  Only  for  highly 
disaggregated  groups  with  between  12  and  19  YOS  did  the  random  component 
seem  to  dominate.  In  the  latter  case,  the  accuracy  of  forecasts  can  be 
predicted  by  simple  continuation  models.  In  the  case  where  nonrandom 
factors  dominate,  models  which  incorporate  the  nonrandom  factors  can 
probably  be  used  to  improve  accuracy. 

From  a  policy  perspective,  a  better  measure  of  predictive  accuracy 
than  deviation  from  binomial  statistics  is  the  percentage  error  in 
forecasts.  The  binomial  theory  imposes  stringent  standards  of  accnracy- 
especially  for  large  groups--and  nonadherence  to  binomial  standards  may 
still  lead  to  acceptable  forecasting  errors  from  a  policy  perspective. 

In  this  section,  the  percentage  errors  in  forecasts  are  calculated  for 
simple  continuation  rate  models. 

The  simplest  model  of  retention  decisions  is  to  simply  assume  the 
retention  rate  will  be  equal  in  the  future  to  the  most  recently  measured 
rate.  While  these  types  of  models  have  the  virtue  of  being  relatively 
simple,  require  minimum  data,  and  guarantee  continuity  with  past 
history--they  are  unlikely  to  predict  well  if  nonrandom,  noncyclic 
factors  are  present.  Here  we  have  calculated  the  historical  accuracy  of 
this  forecasting  technique,  widely  used  in  the  1971-1980  period.  Small 
percentage  errors  would  provide  little  motivation  to  incorporate  more 
complex  techniques  into  large-scale  models.  If  large  percentage  errors 
emerge,  their  pattern  will  be  important  in  determining  the  source  of 
error  as  well  as  some  idea  of  the  expected  improvement  should  behavioral 
models  be  incorporated. 
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Table  2.23 

NUMBER  OF  DEVIATIONS  (10%  SIGNIFICANCE)  FROM  BINOMIAL 
DISTRIBUTION  IN  NINE  YEAR  TO  YEAR  ARMY  RETENTION  COMPARISON'S 


White 

White 

White 

White 

Male. 

,  Cat  Ia 

Male,  Cat  II 

3  Male,  Cat  III 

3  Male,  Cat  I 

Total 

HS 

Grad 

HS  Grad 

HS  Grad 

HS  Grad 

Expected  Number 

of  Deviations 

from  Binomial  Distribution 

1 

1 

1 

1 

1 

YOS 

Actual  Number  of  Deviations 

1 

6 

7 

7 

7 

6 

2 

9 

6 

7 

7 

8 

3 

9 

8 

7 

7 

6 

4 

8 

8 

8 

7 

7 

5 

7 

6 

6 

3 

4 

6 

7 

4 

4 

5 

2 

7 

7 

5 

5 

5 

3 

8 

7 

8 

7 

5 

4 

9 

6 

3 

6 

3 

2 

10 

6 

3 

3 

3 

1 

11 

4 

1 

3 

1 

0 

12 

4 

2 

1 

0 

2 

13 

5 

1 

2 

1 

4 

14 

3 

2 

0 

1 

1 

15 

2 

2 

0 

0 

1 

16 

2 

1 

0 

2 

0 

17 

3 

0 

0 

1 

1 

18 

1 

0 

0 

0 

1 

19 

1 

0 

1 

0 

3 

20 

6 

2 

5 

6 

4 

21 

5 

3 

2 

3 

0 

22 

5 

5 

1 

4 

3 

23 

4 

0 

2 

3 

0 

24 

3 

1 

1 

4 

1 

25 

1 

1 

3 

0 

1 

26 

2 

3 

1 

1 

4 

27 

2 

0 

1 

1 

3 

28 

1 

4 

3 

4 

2 

29 

0 

1 

5 

3 

4 

30 

5 

1 

1 

2 

1 

Total 

Recruits 

are  classlf ied 

into  Category 

I  ,  Category  I  I  , 

Category  IN, 

and  Category  IV  mental  groups,  based  on  scores  received  on  the  entrance 
examination  (Armed  Forces  Qualifying  Test,  or  AFQT).  Category  I  i  11 1 ' 
scores  of  80  and  ubove;  Category  IV  receive  scores  of  30  and  below. 
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the  same  summary  statistics  for  ETS  groups,  and  Table  2.23  provides  the 
statistics  for  more  highly  disaggregated  groups  in  the  Army.  (Appendix 
B  contains  the  full  Z  statistics  for  these  tables.) 

Disaggregation  by  service  and  ETS  group  improves  the  correspondence 
with  binomial  statistics.  Groups  having  an  ETS  during  the  year 
generally  show  more  deviation  during  YOS  4  through  19  than  non-ETS 
groups.  However  even  non-ETS  groups  in  the  years  of  service  12  through 
19  do  not  correspond  to  predictions  from  binomial  statistics. 

The  data  show  that  further  disaggregation  by  demographic, 
education,  and  mental  category  reduces  the  number  of  deviations 
somewhat,  but  there  remain  substantial  differences  from  the  expected 
number  of  deviations  predicted  by  the  binomial  distribution.  These 
differences  are  highest  for  the  early  years  of  service  and  gradually 
decrease  until--for  the  most  disaggregated  groups--the  binomial 
distribution  seems  to  hold  only  for  years  of  service  12  through  19. 

Other  groups  are  clearly  dominated  by  nonrandom  factors. 
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Table  2.22 

NUMBER  OF  DEVIATIONS  (10%  CONFIDENCE  LEVEL)  FROM  BINOMIAL 
DISTRIBUTION  IN  NINE  (FY71-80)  YEAR  TO  YEAR  RETENTION  COMPARISON 


Army 

Navy 

Marine 

Corps 

Air  Force 

DoD 

No  ETS  ETS 

No  ETS 

ETS  No  ETS  ETS 

No  ETS 

ETS 

No  ETS  ETS 

Expected 

Number 

of  Deviations  from 

Binomial 

Distr ibut ion 

Actual  Number  of  Deviations 
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Table  2.21 

NUMBER  OF  DEVIATIONS  (10%  CONFIDENCE  LEVEL) 
FROM  BINOMIAL  DISTRIBUTION  IN  NINE  (FY71-80) 
YEAR  TO  YEAR  RETENTION  COMPARISONS 


Marine  Air 

Army 

Navy  Corps  Force 

DoD 

Expected  Number  of  Deviations 

f  rom 

Binomial  Distribution 

1 

1  1  1 

1 

YOS 

1 

8 

Actual  Number 

8 

of 

7 

Deviat ions 

8 

8 

2 

8 

9 

8 

7 

9 

3 

9 

9 

7 

9 

9 

4 

8 

8 

8 

9 

8 

5 

8 

8 

4 

7 

8 

6 

9 

7 

6 

9 

8 

7 

6 

7 

6 

6 

6 

8 

8 

7 

6 

8 

6 

9 

6 

6 

6 

3 

6 

10 

7 

6 

5 

6 

6 

11 

6 

3 

3 

5 

6 

12 

4 

6 

1 

4 

4 

13 

4 

5 

2 

2 

5 

14 

2 

4 

0 

1 

4 

15 

3 

5 

1 

1 

2 

16 

4 

6 

1 

4 

3 

17 

4 

3 

4 

4 

3 

18 

2 

7 

2 

1 

6 

19 

3 

8 

5 

2 

7 

20 

7 

6 

6 

9 

7 

21 

6 

6 

4 

8 

6 

22 

7 

3 

3 

5 

7 

23 

5 

3 

3 

4 

5 

24 

5 

2 

3 

6 

7 

25 

3 

3 

1 

7 

8 

26 

6 

4 

2 

7 

6 

27 

3 

3 

4 

7 

6 

28 

2 

3 

1 

6 

5 

29 

3 

5 

2 

5 

6 

30 

4 

3 

1 

7 

6 

I 
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would  expect  only  one  in  ten  (1  in  20,  1  in  100)  comparisons  to  be 
rejected  at  the  10  (5,  1)  percent  confidence  level  if  the  means  were  all 
chosen  from  the  same  binomial  distribution.  The  results  for  this  row 
clearly  indicate  variations  from  nonrandom  sources. 

The  summary  statistics  indicate  strongly  that  large  variations  from 
binomial  errors  occur  between  1  and  10  YOS.  In  the  region  11  to  19  YOS, 
much  less  frequent  deviations  from  binomial  errors  occur.  However,  even 
for  11  to  19  YOS,  the  frequency  of  deviation  is  larger  than  expected  on 
a  purely  statistical  basis.  For  20  to  30  YOS,  the  frequency  of 
deviation  from  binomial  errors  again  increases. 

This  pattern  is  the  expected  pattern  given  the  vesting  structure 
and  level  of  benefits  in  the  military  retirement  system  and  the  presence 
of  economic  factors  in  nonrandom  sources  of  variation.  The  current 
vesting  of  military  retirement  at  20  YOS  forces  military  personnel  to 
make  career  decisions  between  the  4th  and  12th  year  of  service. 

Effective  military  pay  which  includes  the  present  value  of  retirement 
benefits  is  large  enough  after  a  certain  point  to  make  it  extremely 
unlikely  that  civilian  pay  could  provide  higher  long-term  compensation. 
Thus,  personnel  decisions  are  increasingly  insulated  (but  never 
completely)  from  the  cyclical  variations  in  the  civilian  labor  market, 
and  between  12  and  19  YOS  essentially  random  factors  such  as  death  and 
disability  dominate  the  retention  statistics. 

Retention  for  groups  not  as  strongly  affected  by  the  structure  of 
military  retirement  will  depend  on  the  availability  and  wage  level  of 
civilian  jobs  that  varied  cyclically  over  the  period  1971-1980.  Thus, 
groups  from  3  to  10  and  20  to  30  YOS  will  have  military  compensation 
whose  level  is  much  closer  to  civilian  opportunities,  and  will  thus  show 
cyclical  behavior  as  civilian  opportunities  change.  Retention  rates  for 
personnel  with  1  to  2  YOS  probably  deviate  from  random  variation  not 
because  of  economic  factors,  but  simply  because  of  differing  cohort 
quality  compos itions . 

The  Z  statistics  for  aggregate  DoD  personnel  across  services  would 
be  expected  to  show  the  largest  deviation  from  binomial  distributions. 
One  question  is  the  extent  to  which  disaggregation  of  military  personnel 
into  more  "homogeneous"  groups  will  reduce  these  deviations.  Table  2  21 
shows  the  summary  statistics  for  the  four  services,  Table  2.22  provides 
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The  hypotheses  that  Ct  and  C  ^  are  from  the  same  underlying 
distribution  can  then  be  tested  at  a  given  confidence  level.  Table  2.19 
gives  the  relationship  between  Z  and  the  confidence  level.  Larger  Z 
values  basically  indicate  a  higher  probability  that  the  mean  difference 
was  not  drawn  from  the  same  binomial  distribution. 

Table  2.20  displays  Z  values  for  active  force  enlisted  personnel 
obtained  from  using  consecutive  year  continuation  rates.  For  instance, 
the  entry  in  the  row  (YOS  =  1)  and  column  (1975)  indicates  that  the 
difference  in  continuation  rates  between  1975  and  1976  was  11.72  times 
the  binomial  standard  error,  a  highly  unlikely  result  if  both  means  were 
drawn  from  the  same  binomial  distribution. 

A  summary  of  the  Z  statistics  for  DoD  for  each  YOS  is  given  at  the 
right  side  of  Table  2.20.  Of  the  nine  comparisons  made  in  each  row,  the 
summary  provides  the  number  of  comparisons  which  are  rejected  at 
confidence  levels  of  10,  5,  and  1  percent.  For  the  first  row,  eight  of 
nine  comparisons  would  be  rejected  at  the  10  percent  level.  Since  we 

Table  2.19 

RELATIONSHIP  BETWEEN  Z  VALUE  AND  CONFIDENCE  LEVELS 


Z  Confidence  level 


.675  Larger  mean  difference  will  occur  50  percent  of  the  time 
1.15  Larger  mean  difference  will  occur  25  percent  of  the  time 
1.645  Larger  mean  difference  will  occur  10  percent  of  the.  time 
1.96  Larger  mean  difference  will  occur  5  percent  of  the  time 
2.575  Larger  mean  difference  will  occur  1  percent  of  the  time 
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applied  repeatedly  to  obtain  1,  3,  or  5  year  forecasts  for  a  given  YOS 
group. 


Pt+5  =  F.  PC  n  rC*  t_1 

YOS  i  i,  YOS-5  i,YOS-j 


population  of  enlisted  personnel  with  given  YOS 
in  time  period  t  +  5. 

population  of  enlisted  personnel  in  homogeneous 

group  i  with  year  of  service  equal  to  YOS  -  5  at 
time  period  t. 

retention  rate  between  time  period  t  and  t  -  1  for 

homogenous  group  i  with  year  of  service  equal  to 
YOS  -  j. 

The  historical  consistency  of  these  data  with  binomial  statistics 
can  be  estimated  using  the  data  described  earlier.  We  will  determine 
the  extent  to  which  the  variation  in  retention  rates  by  YOS  between 
1971-1980  is  consistent  with  a  binomial  distribution.  If  consistent, 
then  year  to  year  accuracy  can  be  predicted  with  the  simple  binomial 
model.  If  not  consistent,  the  variation  could  be  either  larger  or 
smaller  than  binomial.  Smaller  variation  could  indicate  that  retention 
decisions  are  intercorrelated--perhaps  through  manpower  policy 
instruments.  A  simple  example  would  be  to  offer  higher  bonus  amounts 
later  in  a  year  to  compensate  for  lower  retention  generated  randomly 
earlier  in  the  year.  Larger  variation  may  indicate  the  existence  and 
extent  of  nonrandom  factors  influencing  retention  decisions. 

A  test  commonly  used  to  measure  variation  from  a  statistical 
distribution  is  to  compare  the  ratio  of  the  actual  year  to  year 
variation  with  that  predicted  from  the  assumed  statistical  distribution. 
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Table  3.4 


FORECASTING  ACCURACY  FOR  MARINE  CORPS  ENLISTED  PERSONNEL 
UNDER  SIMPLE  CONTINUATION  RATE  ASSUMPTION 


Mean  Absolute  Percentage  Error/100 


Years  of  One  Year  Three  Years  Five  Years 

Service  71-80  76-80  72-77  72-75 


1 

0. 

,019 

0. 

.010 

0. 

,  190 

0. 

261 

2 

0. 

,072 

0 

.040 

0. 

.132 

0. 

.194 

3 

0, 

,058 

0. 

,057 

0. 

.145 

0. 

.  161 

4 

0. 

,078 

0. 

,097 

0. 

,  105 

0. 

.  164 

5 

0, 

.034 

0. 

.012 

0. 

.089 

0. 

.  122 

6 

0. 

,025 

0, 

.024 

0. 

.  106 

0. 

.049 

7 

0. 

,028 

0. 

.030 

0. 

.075 

0. 

.062 

8 

0. 

,032 

0. 

.058 

0. 

.037 

0. 

,026 

9 

0. 

,037 

0. 

,031 

0. 

.060 

0. 

.041 

10 

0. 

.029 

0. 

.042 

0. 

.037 

0. 

.041 

11 

0, 

.014 

0, 

.012 

0. 

.026 

0, 

.047 

12 

0. 

.010 

0, 

.013 

0. 

.020 

0. 

.048 

13 

0. 

.008 

0, 

.010 

0. 

,023 

0. 

051 

14 

0. 

.008 

0 

.007 

0. 

.021 

0. 

,051 

15 

0. 

.008 

0, 

.010 

0. 

.021 

0. 

.157 

16 

0. 

,006 

0. 

.005 

0. 

.020 

0. 

,273 

17 

0. 

.009 

0, 

.004 

0, 

.087 

0. 

.261 

18 

0, 

.006 

0. 

.003 

0 

.  147 

0, 

.257 

19 

0. 

,039 

0, 

.033 

0, 

.  134 

0. 

,  264 

0, 

.099 

0 

.069 

0 

.  140 

0, 

.240 

21 

0 

.065 

0 

.029 

0 

.  156 

0, 

.293 

22 

0. 

.076 

0 

.023 

0 

.  135 

0, 

.285 

23 

0. 

.054 

0 

.026 

0 

.  102 

0 

.213 

24 

0 

.054 

0 

.045 

0 

.  102 

0 

.258 

25 

0. 

.037 

0 

.018 

0 

.111 

0 

,  305 

26 

0 

.077 

0 

.027 

0 

.111 

0 

.441 

27 

0 

.077 

0 

.086 

0 

.204 

28 

0 

.057 

0 

.027 

0 

.448 

29 

0 

.093 

0 

.  098 

30 

0 

.173 

0 

.  279 
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ONE-YEAR  FORECASTS 

In  the  1971-79  period,  the  greatest  percentage  errors  in 
forecasting  in  each  service  occurred  in  the  years  of  service  2  through  4 
and  20  through  30,  where  average  percentage  errors  are  almost  always 
less  than  10  percent.  For  between  5  and  10  years  of  service,  average 
percentage  errors  are  usually  less  than  3  percent.  In  the  YOS  range  11 
to  19,  average  percentage  errors  are  less  than  1  percent.  For  the  first 
year  of  service,  average  percentage  error  does  not  exceed  4  percent  for 
any  service. 

Forecasting  accuracy  should  improve  for  the  1976-79  period  around 
first-term  retention  because  of  the  absence  of  draft-motivated 
personnel.  The  data  generally  show  reduced  average  error  rates  for  this 
period  when  compared  to  the  1971-79  period. 

The  somewhat  surprising  accuracy  of  one-year  forecasts  during  a 
period  marked  by  a  rapidly  changing  economic  environment  and  a  policy 
environment  marked  by  transition  to  an  all-volunteer  force  can  be 
attributed  partly  to  a  key  structural  parameter  of  the  military  manpower 
system--the  term  of  service.  Most  military  personnel  have  at  least 
3-year  terms  of  service  and  some  have  up  to  6-year  terms.  The  result  is 
that  only  about  20  to  25  percent  of  military  personnel  make  an  ETS 
decision  annually  (see  Table  3.6).  Thus,  75  percent  of  personnel  are  in 
a  highly  stable  and  fairly  predictable  non-ETS  status.  This  is 
illustrated  when  accuracy  is  calculated  for  both  ETS  and  non-ETS  groups 
(see  Tables  3.7  through  3.11).  This  accurate  forecasting  in  the  short 
term  does  not  require  highly  accurate  forecasting  of  ETS  decisions.  The 
remarkable  accuracy  of  one-year  forecasts  hides  a  somewhat  inaccurate 
forecast  for  ETS  groups.  One-year  errors  for  ETS  groups  range  from  10 
to  30  percent  for  groups  with  2  to  4  YOS. 
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Table  3.7 

A  MEASURE  OF  FORECASTING  ACCURACY  UNDER  A  SIMPLE 
CONTINUATION  ASSUMPTION  FOR  DOD  ENLISTED  PERSONNEL 


Mean  Absolute  Percentage  Error/100 


Non-ETS 


ETS 


Both  Groups 


Years  of 


Service 

1971-80 

1976-80 

1971-80 

1976-80 

1971-80 

1976-80 

1 

0.025 

0.009 

0.027 

0.009 

2 

0.034 

0.012 

0.251 

0.208 

0.077 

0.028 

3 

0.030 

0.020 

0.207 

0.111 

0.064 

0.053 

4 

0.054 

0.007 

0.132 

0.118 

0.081 

0.070 

5 

0.009 

0.004 

0.092 

0.085 

0.018 

0.017 

6 

0.004 

0.004 

0.080 

0.093 

0.013 

0.015 

7 

0.005 

0.003 

0.079 

0.114 

0.012 

0.017 

8 

0.008 

0.003 

0.074 

0.098 

0.013 

0.020 

9 

0.003 

0.003 

0.041 

0.059 

0.007 

0.009 

10 

0.002 

0.002 

0.037 

0.037 

0.006 

0.003 

11 

0.002 

0.002 

0.030 

0.033 

0.005 

0.005 

12 

0.002 

0.001 

0.021 

0.022 

0.003 

0.003 

13 

0.002 

0.002 

0.021 

0.022 

0.003 

0.004 

14 

0.002 

0.001 

0.012 

0.007 

0.002 

0.002 

15 

0.001 

0.001 

0.007 

0.007 

0.001 

0.001 

16 

0.001 

0.002 

0.006 

0.002 

0.002 

0.002 

17 

0.001 

0.001 

0.010 

0.006 

0.001 

0.001 

18 

0.004 

0.004 

0.012 

0.005 

0.004 

0.004 

19 

0.018 

0.023 

0.051 

0.033 

0.019 

0.024 

20 

0.050 

0.029 

0.076 

0.057 

0.046 

0.047 

21 

0.038 

0.042 

0.124 

0.109 

0.035 

0.044 

22 

0.031 

0.030 

0. 140 

0.084 

0.025 

0.041 

23 

0.019 

0.025 

0.104 

0.128 

0.024 

0.031 

24 

0.026 

0.025 

0.078 

0.094 

0.035 

0 . 035 

25 

0.024 

0.022 

0.062 

0.054 

0.026 

0 . 078 

26 

0.029 

0.035 

0.156 

0.110 

0.047 

0.037 

27 

0.049 

0.052 

0.0/2 

0.090 

0.044 

0.045 

28 

0.025 

0.030 

0.187 

0.213 

0.059 

0.06  5 

29 

0.052 

0.040 

0.  1 15 

0.074 

0.074 

0 . 0.5'> 

30 

0.159 

0.  133 

0.232 

0.182 

0.235 

0.173 
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Table  3.10 

A  MEASURE  OF  FORECASTING  ACCURACY  UNDER  A  SIMPLE 
CONTINUATION  ASSUMPTION  FOR  MARINE  CORPS  ENLISTED  PERSONNEL 


Mean  Absolute  Percentage  Error/100 


Non 

-ETS 

ETS 

Both  Groups 

Years  of 

Service 

1471-80 

1976-80 

1971-80 

1976-80 

1971-80 

1976-80 

1 

0.020 

0.010 

0.019 

0.010 

2 

0.028 

0.017 

0.221 

0.319 

0.072 

0.040 

3 

0.040 

0.020 

0.215 

0.117 

0.058 

0.057 

4 

0.055 

0.025 

0.088 

0.105 

0.078 

0.097 

5 

0.039 

0.024 

0.113 

0.064 

0.034 

0.012 

6 

0.014 

0.006 

0.097 

0.112 

0.025 

0.024 

7 

0.018 

0.010 

0.071 

0.103 

0.028 

0.030 

8 

0.009 

0.006 

0.062 

0.079 

0.032 

0.058 

9 

0.012 

0.013 

0.064 

0.054 

0.037 

0.031 

10 

0.011 

0.006 

0.049 

0.077 

0.029 

0.042 

11 

0.006 

0.004 

0.053 

0.048 

0.014 

0.012 

12 

0.007 

0.004 

0.032 

0.048 

0.010 

0.013 

13 

0.008 

0.007 

0.019 

0.019 

0.008 

0.010 

14 

0.007 

0.006 

0.015 

0.016 

0.008 

0.007 

15 

0.009 

0.009 

0.022 

0.022 

0.008 

0.010 

16 

0.007 

0.005 

0.016 

0.014 

0.006 

0.005 

17 

0.010 

0.007 

0.014 

0.015 

0.009 

0.004 

18 

0.007 

0.004 

0.015 

0.016 

0.006 

0.003 

19 

0.026 

0.018 

0.093 

0.100 

0.039 

0.033 

20 

0.077 

0.065 

0.111 

0.097 

0.099 

0.069 

21 

0.060 

0.047 

0.130 

0.113 

0.065 

0.029 

22 

0.046 

0.035 

0.151 

0.108 

0.076 

0.02  3 

23 

0.027 

0.011 

0.082 

0.035 

0.054 

0.026 

24 

0.055 

0.030 

0.085 

0.056 

0.054 

0.045 

25 

0.043 

0.028 

0.079 

0.083 

0.037 

0.018 

26 

0.064 

0.029 

0.120 

0.066 

0.077 

0.027 

27 

0.049 

0.045 

0.171 

0.142 

0.077 

0.086 

28 

0.069 

0.015 

0.103 

0.095 

0.057 

0.027 

29 

0.067 

0.044 

0.244 

0.235 

0.093 

0.09R 

30 

0.161 

0.118 

0.330 

0.311 

0.  173 

0.279 
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Table  3.11 

A  MEASURE  OF  FORECASTING  ACCURACY  UNDER  A  SIMPLE 
CONTINUATION  ASSUMPTION  FOR  AIR  FORCE  ENLISTED  PERSONNEL 


Mean. Absolute  Percentage  Error/100 


Non-ETS 

ETS 

Both  Groups 

Years  of 
Service 

1971-80  1976-80 

1971-80  1976-80 

1971-80  1976-80 

1 

0 

016 

0 

010 

-- 

0 

016 

0 

010 

2 

0 

016 

0 

013 

0 

017 

0 

014 

3 

0 

069 

0 

037 

0 . 454 

0 . 208 

0 

068 

0 

038 

4 

0 

097 

0 

008 

0.285 

0.224 

0 

123 

0 

12b 

5 

0 

017 

0 

010 

0.168 

0.075 

0 

015 

0 

014 

6 

0 

006 

0 

004 

0.229 

0.187 

0 

035 

0 

049 

7 

0 

Oil 

0 

007 

0.192 

0.135 

0 

021 

0 

017 

8 

0 

022 

0 

007 

0.181 

0.124 

0 

021 

0 

035 

9 

0 

007 

0 

007 

0.174 

0.087 

0 

008 

0 

015 

10 

0 

004 

0 

004 

0.143 

0.049 

0 

007 

0 

on 

11 

0 

004 

0 

004 

0. 141 

0.051 

0 

009 

0 

013 

12 

0 

004 

0 

002 

0.125 

0.027 

0 

006 

0 

010 

13 

0 

003 

0 

003 

0.128 

0.025 

0 

003 

0 

004 

14 

0 

002 

0 

003 

0.126 

0.018 

0 

002 

0 

003 

15 

0 

002 

0 

002 

0.117 

0.011 

0 

001 

0 

002 

16 

0 

002 

0 

003 

0.114 

0.004 

0 

002 

0 

003 

17 

0 

002 

0 

002 

0.116 

0.007 

0 

002 

0 

002 

18 

0 

001 

0 

001 

0.117 

0.005 

0 

001 

0 

001 

19 

0 

001 

0 

002 

0.124 

0.005 

0 

001 

0 

001 

20 

0 

065 

0 

022 

0.199 

0.106 

0 

074 

0 

066 

21 

0 

067 

0 

055 

0.337 

0.350 

0 

070 

0 

073 

22 

0 

046 

0 

037 

0.352 

0.166 

0 

044 

0 

060 

23 

0 

041 

0 

031 

0.276 

0.244 

0 

040 

0 

045 

24 
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THREE-  AND  FIVE-YEAR  FORECASTS 

Forecasting  errors  for  three  and  five  years  are  larger  than  those 
for  one-year  forecasts.  If  random  events  were  the  determining  factor, 
these  errors  should  be  approximately  the  same  magnitude.  The  increases 
are  probably  due  to  the  fact  that  by  five  years  practically  all 
individuals  will  have  had  an  ETS  decision,  and  nonrandom  factors 
operating  at  that  point  in  each  year  cause  a  widening  cumulative  error. 
Average  errors  for  cohorts  moving  from  year  of  service  1  and  2  generally 
fall  between  12  and  20  percent  for  3-year  forecasts  and  between  20  and 
30  percent  for  5-year  forecasts.  This  means  that  the  size  of  a  cohort 
moving  from  year  1  or  2  to  year  4  to  5  cannot  be  estimated--using  the 
simple  models--to  accuracy  greater  than  12  to  20  percent  or  20  to  30 
percent  for  movement  from  year  1  or  2  to  year  6  or  7.  Accuracy  improves 
for  later  cohorts.  For  cohorts  beginning  at  YOS  3  or  4,  3-year  errors 
tend  to  be  between  10  and  15  percent,  whereas  5-year  errors  are  between 
12  and  20  percent.  The  magnitude  of  errors  decreases  until  for  cohorts 
starting  between  years  of  service  12-14,  3-year  errors  are  usually  less 
than  2  percent,  whereas  5-year  errors  are  less  than  5  percent.  Errors 
dramatically  increase  for  personnel  moving  through  the  reenlistment 
point  of  20  years.  Three-year  forecast  errors  are  generally  less  than 
15  percent,  whereas  5-year  errors  are  usually  less  than  20  percent.  The 
four  services  show  remarkably  similar  patterns,  with  the  Marine  Corps 
showing  a  slightly  higher  error  rate  than  the  other  services. 


-  v  .  V. 
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IV.  INTEGRATING  BEHAVIORAL  ESTIMATES  INTO  LARGE, 
OPERATIONAL  ENLISTED  FORCE  MODELS 


Understanding  the  accuracy  with  which  projections  of  enlisted  force 
strength  and  structure  can  been  made  is  essential  to  the  design  of 
models  that  have  as  their  purpose  the  control  of  key  aggregate  manpower 
parameters  such  as  end  strength,  accession  requirements,  first 
term/career  mix,  and  pay  and  bonus  budgets.  A  knowledge  of  this 
accuracy  allows  more  cost  effective  hedging  of  personnel  policies  and 
suggests  where  controls  need  to  be  implemented  to  better  manage  the 
enlisted  force.  More  importantly,  it  can  provide  directions  for 
improving  enlisted  force  modeling  in  a  way  that  leads  to  greater 
accuracy  and  more  parsimonious  models.  The  latter  criterion  is  an 
important  consideration  in  model  design--especially  at  the  OSD  level-- 
where  staff  size  can  limit  the  scope  of  modeling  activities  and  staff 
turnover  can  quickly  make  complex  models  extinct. 

Manpower  models  designed  for  setting  enlisted  force  policy  have 
been  of  two  types.  The  first  type  has  as  their  primary  purpose  the 
control  of  aggregate  manpower  parameters  such  as  end  strength,  trained 
strength,  accession  requirements,  direct  manpower  compensation  costs, 
and  enlisted  force  profiles.  These  models  basically  project  manpower 
losses  at  different  experience  levels,  generate  the  level  and  type  of 
manpower  gains  needed  to  meet  end  strengths,  and  then  produce  future 
enlisted  force  profiles  and  budgetary  costs.  The  format,  approach,  and 
sophistication  of  these  models  differ  markedly  by  service. 

The  second  type  of  modeling  has  been  directed  at  deriving  equations 
that  describe  retention  or  continuation  behavior.  These  models  provide 
measurements  of  the  effect  of  a  variety  of  variables  on  enlisted  force 
retention.  Variables  typically  included  in  such  models  include  military 
and  civilian  pay  levels,  policy  variables,  unemployment,  and  demographic 
character ist ics .  The  models  arc  usually  directed  at  modeling  a 
particular  enlistment  or  reenlistment  decision  (first  term  or  second 
term),  but  models  also  have  been  developed  which  attempt  to  explain 
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sequences  of  retention  decisions.1  These  types  of  models  serve  two 
purposes.  The  first  is  to  define  certain  key  parameters  which  are  used 
in  the  policy  adjustments  of  retention  rates.  These  parameters 
essentially  specify  how  changes  in  pay  and  unemployment  will  affect 
retention  rates.  The  second  purpose  is  to  make  forecasts.  Forecasts 
can  be  made  provided  the  future  values  of  independent  variables  are 
known . 

The  results  of  these  enlistment  and  retention  models  as  well  as 
results  from  earlier  sections  have  shown  the  importance  of  economic 
variables  in  enlistment  and  retention  decisions.  Enlistment  and 
retention  decisions  have  been  shown  to  be  sensitive  to  unemployment 
rates  and  civilian  and  military  pay  levels.  It  would  seem  a  natural 
step  to  incorporate  these  models  into  the  framework  of  the  larger 
operating  models  which  need  estimates*  of  retention  and  continuation 
rates  as  critical  components.  This  integration  would  allow  simulation 
of  the  effects  of  changes  of  policy  and  economic  cycles  on  aggregate 
manpower  trends  and  development  of  countercyclical  policies  to  smooth 
cyclical  effects.  It  should  also,  in  principle,  allow  more  accurate 
forecasting  of  retention  rates--although  this  point  has  not  been  subject 
to  well  documented  empirical  validation. 

Realizing  the  potential  for  increased  accuracy  by  integrating 
behavioral  models  into  manpower  systems  models  means  overcoming  several 


'For  an  example,  see  G.  A.  Gotz  and  J.  J.  McCall,  A  Dynamic 
Retention  Model  for  Air  Force  Of f icers :  Theory  and  Estimate ,  R-3028-AF, 
The  Rand  Corporation,  December  1984. 

*Other  nonbehavioral  techniques  for  projecting  losses  have  been 
used  or  suggested.  One  technique  involves  maintaining  the  basic 
disaggregation  strategy  but  estimating  future  continuation  rates  from  a 
series  of  past  continuation  rates.  Techniques  can  include  simple 
averages  of  past  rates,  time  trends,  exponential  smoothing,  or  spectral 
analysis.  Exponential  smoothing  is  a  flexible  curve- f itt ing  technique 
where  user  intervention  can  set  certain  constants.  Setting  these 
constants  can  reflect  either  assessments  of  the  relative  weight  given  to 
historical  data  or  possible  future  economic  conditions.  This  subjective 
intervention  makes  evaluation  of  these  models  difficult,  and  leaves  them 
highly  dependent  on  the  quality  of  "experts."  Spectral  analysis 
techniques  are  also  flexible  and  are  especially  suited  to  fitting 
cyclical  or  periodic  data  which  require  no  user  intervention.  However, 
this  technique  works  best  when  a  long  series  of  historical  data  is 
available  so  that  cyclical  and  periodic  patterns  can  be  detected.  Since 
current  enlisted  force  data  bases  contain  only  10  years  of  data,  these 
techniques  do  not  seem  currently  useful. 
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barriers  which  can  prevent  successful  integration  and  avoiding  some 
pitfalls  which  could  actually  decrease  accuracy. 

One  critical  problem  is  that  econometric  equations  are  rarely 
developed  for  the  ideal  time  periods  or  precise  manpower  groups  needed 
by  manpower  systems  models.  This  mismatch  is  due  fundamentally  to 
differing  primary  objectives  of  the  two  activities.  Econometric 
estimates  usually  have  as  their  main  purpose  the  measurement  of  a  policy 
parameter  like  pay  elasticity  rather  than  a  time-sensitive  forecast. 

The  choice  of  a  data  series  to  make  an  estimation  is  often  based  on  some 
measurement  advantage  or  simple  data  availability.  In  the  former  case, 
the  measurement  advantage  might  include  experimental  conditions  or  a 
large  time  series  or  cross-sectional  variation  in  certain  variables. 
Estimation  can  be  a  lengthly  process,  so  that  available  equations  cover 
time  periods  which  lag  by  a  year  or  two  the  starting  point  for  needed 
manpower  forecasts. 

On  the  other  hand,  manpower  systems  models  need  econometric 
equations  estimated  for  specific  longitudinal  data  series  specified  by 
the  disaggregation  scheme  of  the  model.  These  data  series  should 
include  the  most  recent  time  periods  prior  to  the  forecasting  periods. 
Continuously  providing  these  kinds  of  estimates  would  considerably 
expand  the  scope  of  present  manpower  systems  models.  These  models  would 
need  an  extensive  decision  support  system  devoted  to  storage  of 
longitudinal  data.  This  data  base  would  need  to  contain  not  only 
longitudinal  data  at  the  individual  level  for  specific  manpower  cells, 
but  also  extended  data  series  of  independent  variables.  These  would 
include  civilian  and  military  pay  series,  bonus  payments,  unemployment 
indicators,  and  policies  affecting  retention  such  as  changing  benefits. 
These  series  could  differ  between  manpower  groups  so  the  number  of 
series  would  proliferate  with  the  number  of  i  i s aggreg 1 1 ed  groups.  For 
instance,  civilian  pay  series  would  •hl!cr  for  miles  and  females,  and 
for  different  races  and  eiucat.on  groups. 

Since  present  manpower  systems  are  usually  highly  disaggregated- - 
often  containing  thousands  of  cel  is- -  integral  ion  of  behavioral  equations 
and  the  associated  data  support  could  be  a  significant  investment.  1 h i  ■- 
integration  also  makes  the  models  m-'i e  complex  and  somewhat  less 
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responsive,  and  raises  the  "price"  of  disaggregation.  For  such 
integrated  models  parsimony  and  concern  for  accuracy  should  dictate 
where  econometric  estimates  are  used  and  the  basic  disaggregation 
structure  of  the  model.  Part  of  the  large-scale  disaggregation  in 
present  models  may  be  an  attempt  to  compensate  for  the  lack  of  accuracy 
inherent  when  economic  parameters  are  not  taken  into  account.  Less 
disaggregated  models  incorporating  economic  variables  may  be  more 
accurate  than  highly  disaggregate  models  without  them. 

Using  more  sophisticated  econometric  models  and  further 
disaggregation  is  warranted  only  where  significant  gain  in  accuracy  is 
achievable.  Our  results  in  this  Note  fortunately  indicate  that  high 
levels  of  disaggregation  may  not  improve  accuracy  much,  and  econometric 
models  may  be  warranted  only  for  longer  term  forecasts  for  ETS  groups 
with  between  3  and  10  years  of  service.  Although  error  rates  are  high 
for  groups  with  greater  than  20  years  of  service,  the  small  size  of 
these  groups  make  improved  models  unnecessary  for  most  policy 
applications.  A  more  problematical  group  is  the  1-3  YOS  group.  It  is 
important  to  predict  these  groups  accurately  since  they  are  the  largest 
in  the  enlisted  force.  Non-ETS  attrition  in  these  groups  appears  to  be 
more  stable  than  present  attrition  models  based  on  personnel 
characteristics  would  predict.  This  may  indicate  that  service  attrition 
policies  are  directed  toward  creaming  any  incoming  cohort  regardless  of 
composition.  Thus,  traditional  methods  of  disaggregation  of  these 
groups  by  qualitative  characteristics  may  not  produce  accurate 
estimates.  Instead,  qualitative  criteria  supplemented  by  upper  level 
bounds  on  overall  attrition  levels  may  produce  more  accurate  estimates. 

A  second  major  problem  with  integrating  behavioral  models  into 
manpower  systems  models  is  the  instability  of  estimations  from 
econometric  models.  This  instability  can  be  caused  by  dynamic 
instability  in  the  behavioral  phenomena  being  measured- -but  is  probably 
more  often  caused  by  other  factors.  These  factors  include  the  lack  of  a 
unique  theoretically  determined  model,  different  measures  of  variable;, 
different  estimation  techniques,  and  use  of  different  time  periods  in 
the  estimations.  Estimation  is  still  somewhat  of  an  art  loosely 
constrained  by  theory.  Thus,  it  is  important  to  have  a  uniform,  well- 
regulated  process  for  comparing  forecasts  and  for  documenting 
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assumptions,  model  specifications,  and  estimation  procedures.  It  is 
important  to  distinguish  between  differences  in  models  and  differences 
in  forecasts.  Differences  in  models  or  estimations  might  frequently 
produce  little  differences  in  forecasts. 

A  third  problem  with  incorporation  is  the  need  to  predict  future 
values  of  independent  variables  in  the  econometric  models.  The  models 
contain  variables  that  are  outside  DoD  policy  control  and  for  which 
future  values  may  be  highly  uncertain.  The  accuracy  of  forecasts  is 
thereby  dependent  not  only  on  the  "quality"  of  model  specifications  and 
the  statistical  characteristics  of  the  model  estimations,  but  also  on 
uncertainity  in  assigning  values  to  future  parameters. 

Another  complication  is  that  the  functional  forms  used  to  fit 
econometric  equations  may  not  be  compatible  with  those  needed  in 
manpower  systems  models.  Nonlinear  logit  functions  are  often  used  to 
fit  the  dichotomous  retention  or  attrition  behavior.  The  logit 
estimates  give  the  probability  of  attrition  or  retention  for  individuals 
with  differing  characteristics  under  different  choices  of  policy 
parameters  (military  pay)  and  other  factors  (unemployment).  This 
functional  form  is  chosen  primarily  because  of  its  asymptotic  behavior 
which  limits  the  probability  value  to  between  zero  and  one.  The  problem 
arises  when  these  individual  level  estimates  are  used  to  predict  the 
retention  or  attrition  behavior  of  a  heterogenous  group  of  enlisted 
personnel.  The  accepted  method  for  deriving  the  retention  rate  of  a 
group  is  to  calculate  the  logit  probability  for  each  individual  and  sum 
these  probabilities  over  the  group.  In  manpower  systems  models  this 
procedure  requires  an  unmanageably  large  individual  level  data  base  and 
redesign  of  the  models  using  microsimulation.  Instead,  simple  linear 
fits  using  estimates  from  the  logit  fits  are  usually  developed  that  can 
be  varied  continuously  within  certain  limits  of  the  independent 
variables . 

A  second  reason  is  that  nonlinear  functions  can  complicate  these 
larger  optimization  models  which  attempt  to  choose  values  or  policy 
variables  contained  in  the  continuation  rate.  Large-scale  linear 
optimization  models  can  easily  adapt  to  linear  functions.  However, 
retention  rates  cannot  be  estimated  with  linear  functions  since  values 
of  the  dependent  variable  must  be  V jpt  between  zero  and  one. 
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Incorporating  nonlinear  function  means  additional  computational  work  to 
develop  piecewise  linear  functions  or  change  to  a  nonlinear  programming 
environment.  In  the  latter  case,  the  "size"  of  the  problem  is  much  more 
restrictive  than  with  linear  programming. 

A  final  reason  for  lack  of  integration  is  that  the  magnitude  of 
differences  in  forecasting  accuracy  between  the  simple  continuation 
models  and  more  sophisticated  models  has  not  been  estimated.  The 
difference  between  the  two  types  of  models  may  not  be  sufficient  to 
justify  the  resources  necessary  for  incorporating  the  more  complex 
models.  Unfortunately,  forecasts  are  not  routinely  made  by  those 
building  econometric  retention  models.  Given  that  forecasts  occur,  a 
tracking  system  to  measure  the  historical  accuracy  of  various  models  is 
critical  to  the  process  of  model  validation  and  improvement.  This 
process  is  perhaps  the  key  missing  ingredient  in  improving  enlisted 
force  forecasting. 

Tracking  the  accuracy  with  which  enlisted  manpower  levels  can  be 
forecast  is  useful  not  only  in  designing  improved  forecasting  levels, 
but  the  expected  uncertainty  in  forecasts  is  itself  a  key  policy 
planning  parameter.  Determining  the  likely  accuracy  of  forecasts  allows 
managers  to  properly  hedge  their  actions  to  meet  requirements  with 
prescribed  levels  of  confidence.  It  is  often  more  important  to  assume 
with  a  high  degree  of  confidence  that  manpower  of  certain  types  will 
exceed  a  certain  level  than  to  simply  be  able  to  predict  the  expected 
value  of  a  level.  The  amount  of  hedging  required  will  depend  partly  on 
the  level  of  uncertainity--more  uncertainity  means  more  hedging. 

Hedging  is  accomplished  through  planning  for  a  level  of  manpower  above 
requirements.  Several  other  parameters  determine  the  increment  over 
requirements  necessary  for  hedging--thc  level  of  confidence,  the 
perceived  cost  of  shortages,  the  cost  of  the  additional  manpower,  and 
the  number  of  personnel  in  the  inventory. 

Taking  account  of  uncertainity  in  planning  the  levels  of  enlisted 
manpower  inventories  of  various  types  is  essential  to  effective 
management  of  the  enlisted  force.  These  factors  make  enlisted  force 
planning  not  a  simple  quantitative  exercise  in  forecasting  from  exist itig 
historical  data,  but  a  coordinated  organizational  effort  to  make 
explicit  and  estimate  (sometimes  subjectively)  the  uncertainty  in 
forecasts,  costs  of  shortages,  and  required  levels  of  confidence. 
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V.  CONCLUSIONS 


This  study  of  the  accuracy  of  enlisted  strength  forecasting  in  the 
four  services  for  fiscal  years  1971  through  1980  shows  that  simple 
continuation  rate  models  have  severe  limitations  when  projecting  over 
three  or  five  years.  Forecasting  errors  arise  because  of  large  errors 
encountered  in  forecasting  for  ETS  groups  that  tend  to  be  cumulative. 
These  ETS  errors  are  largest  for  personnel  at  first  and  second  term  and 
between  20  and  30  YOS.  Breaking  enlisted  groups  into  finely 
disaggregated  subgroups  improves  forecasting  only  a  little.  The  major 
component  contributing  to  error  appears  to  be  a  nonrandom  component 
occurring  at  the  point  of  ETS  that  is  correlated  across  enlisted  groups 
by  YOS.  Failure  to  incorporate  these  nonrandom  components  severely 
limits  the  accuracy  of  enlisted  force  forecasting.  These  nonrandom 
components  are  being  systematically  incorporated  into  the  enlisted  force 
models  of  the  four  services.  Many  analytical  and  practical  problems 
remain  to  valid  integration.  Thus,  forecasting  accuracy  of  these  models 
may  be  limited  and  need  systematic  tracking. 

These  nonrandom  components  are  attributable  to  variations 
associated  with  the  economic  cycle.  Econometric  estimates  made  over  a 
number  of  years  have  shown  the  sensitivity  of  ETS  decisions  to  economic 
variables.  Moreover,  the  pattern  of  errors  found  in  this  study  is 
consistent  with  the  hypothesis  that  missing  economic  variables  are  the 
main  contributers  to  the  error  rates  for  three-  and  five-year  forecasts. 
Making  enlisted  forecasting  more  accurate  means  finding  ways  of 
incorporating  these  variables  into  the  enlisted  models  of  the  services. 

This  incorporation  of  economic  variables  into  the  large-scale 
enlisted  force  models  of  the  services  should  be  one  goal  of  enlisted 
force  management.  Perhaps  the  major  problem  in  enlisted  force 
management  in  the  next  five  years  will  be  developing  countercyclical 
policies  during  a  period  of  improving  economy.  This  kind  of  planning 
will  be  impossible  unless  the  services  themselves  can  generate  these 
estimates.  Moreover,  OSD  should  not  duplicate  the  capability  that 
exists  within  the  services  for  enlisted  force  modeling.  Rather,  USD 
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should  be  in  a  position  to  exert  influence  on  the  direction  of  modeling 
activities  within  the  services  through  its  review  and  understanding  of 
model  assumptions,  and  to  coordinate,  where  appropriate,  modeling 
assumptions  across  services.  Three  critical  components  in  performing 
these  functions  are  the  ability  to  test  and  track  the  accuracy  of 
enlisted  manpower  projections,  a  process  for  coordinating  and 
establishing  common  assumptions  across  services,  and  revised  Department 
of  Defense  Instructions  that  emphasize  model  assumptions  in  addition  to 
model  outputs. 

Testing  the  accuracy  of  enlisted  models  requires  developing  a 
certain  type  of  enlisted  force  model  at  the  OSD  level  that  can  be  used 
to  check  the  output  of  service  models  against  some  standard  model 
assumptions.  Such  models  should  emphasize  flexibility  and  decision 
support  capability  rather  than  comprehensiveness  or  even  technical 
sophistication  or  complexity. 

There  are  several  barriers  to  incorporating  behavioral  estimates 
into  the  large-scale  models.  The  high  degree  of  disaggregation  used  in 
most  models  means  making  a  large  number  of  behavioral  estimates.  This 
study,  however,  indicates  that  a  high  degree  of  disaggregation  may  not 
contribute  greatly  to  improving  accuracy.  In  fact,  less  disaggregated 
models  incorporating  economic  variables  may  provide  far  greater  accuracy 
than  highly  disaggregated  models  without  economic  variables. 

This  study  has  also  shown  that  behavioral  estimates  may  only  be 
needed  for  certain  key  groups.  Simple  continuation  models  often  provide 
surprisingly  good  estimates.  Another  barrier  is  development  of 
estimates  that  are  based  on  the  behavioral  history  of  the  group  being 
forecast.  Although  several  econometric  estimates  have  been  made  on 
differing  groups  at  different  times,  ad  hoc  extractions  of  parameters 
from  these  models  and  incorporation  into  other  models  are  dangerous. 
Rather,  resources  need  to  be  devoted  to  maintaining  a  fairly  large 
support  system  of  longitudinal  data  so  that  estimates  can  be  generated 
for  key  groups  rather  easily.  The  problem  will  still  remain  that 
econometric  estimates  are  not  highly  reliable  or  repeatable  across 
similar  groups  at  different  times.  So  part  of  the  estimation  capability 
must  be  ways  of  statistically  testing  the  effect  of  different  parameters 
on  the  overall  quality  of  fit. 
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Yet  another  barrier  is  that  behavioral  models  themselves  need 
estimates  of  future  economic  parameters.  These  estimates  have  not  been 
highly  reliable  in  the  past.  Thus,  it  is  important  to  have  a  mechanism 
for  establishing  consistent  estimates  of  these  parameters  across 
services  and  a  means  to  test  sensitivities  to  variations  from  forecasts. 
Another  barrier  concerns  the  specification  and  linking  of  functional 
forms  for  the  behavioral  models.  Current  logit  functional  forms--often 
used  in  behavioral  estimates  of  discrete  choice- -may  provide  poor 
quality  of  fits  over  certain  portions  of  the  curve.  These  poor  fits 
could  interfere  with  the  goal  of  providing  overall  improved  accuracy. 
More  research  is  needed  to  develop  better  fitting  forms.  Finally, 
incorporating  these  more  complex  functional  forms  into  enlisted  force 
models  may  be  simple  in  certain  types  of  models,  but  more  complex  in 
optimization  models  which  have  traditionally  relied  on  linear  estimates. 
However,  none  of  these  barriers  is  of  sufficient  complexity  to  deter 
movement  forward.  Indeed,  the  results  of  this  study  seem  to  indicate  a 
marked  improvement  in  enlisted  forecasting  accuracy  may  be  possible  with 
models  that  are  estimated  from  continuous  longitudinal  data  for  the 
group  in  question--but  that  incorporate  fairly  simple  economic 
variables . 
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Appendix  A 
THE  DATA  BASE 


The  data  base  was  constructed  by  matching  (by  Social  Security 
number)  beginning  fiscal  year  master  file  records  for  each  service  with 
ending  fiscal  year  records.  Flags  were  then  attached  to  the  data 
records  to  indicate  either  a  match  or  a  nonmatch.  Master  file  records 
were  next  extracted  and  saved  for  each  beginning  year  record- -where  a 
match  existed--for  a  end  year  record.  An  extract  of  this  tape  with  the 
data  elements  of  Table  A.l  was  then  made. 


PREVIOUS  PAGE 
IS  BLANK 


— 
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DATA  ELEMENTS  INCLUDED  ON  TAPE  EXTRACT 


Position 

Description 

1 

Social  Security  Number 

3 

DoD  Primary  Occupation  Code 

4 

DoD  Duty  Occupation  Code 

6 

AFQT  Percentile  Score 

7 

Pay  Grade 

8 

Home  of  Record 

9 

Date  of  Birth 

10 

Service 

11 

Race 

12 

Source  of  Original  Procurement 

13 

Duty  in  Vietnam 

14 

Marital  Status 

15 

Number  of  Dependents 

17 

Ethnic  Group 

19 

Sex 

21 

Education  Group 

23 

Mental  Category 

24 

Age  at  Entry 

26 

Primary  MOS 

31 

ETS  Date 

32 

Date  of  Current  Pay  Grade 

34 

Service  Component 

35 

TAFMS  Group 

38E 

Variable/Selective  Reenlistment 
Bonus  Multiplier 

39E 

Proficiency  Pay 

40E 

Reenlistment  Eligibility 

45 

Spanish  Surname  Flag 
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